We build a strong log-collection system to analyze total logs of our operation teams (including system ,database, web service ,load balance ,audit, cache system , hardware, iDrac logs). All of these logs are used to build a high streaming log system to find a particular performance point of our apps[……]
Donkey – system for MySQL automatic maintenance
We build this system based on Inception (Qunar)。
All of MySQL DDL/DML operations are based on Donkey system, with strict approval process to keep online system strong and available.
Open this file by Mockplus Donkey-system[……]
TCP Trace
I found a useful tool named sniffer to help us analyze network packages (this tool can capture packages on specific port)
I use sniffer to analyze mysql and redis packages (translate these packages to normal queries)
#./vc-redis-sniffer –help
vc-redis-sniffer is a utility from VividCortex[......]
MySQL TCPCOPY
Infiniflash Benchmark
Sandisk (FusionIO) and Nexenta are working together to build this SDS solution.
Infiniflash is a very large SDS production, which manages for very large DW system who requires large storage space and also high IOPS.
We test infiniflash system ,read this Infiniflash_benchmark[……]
MySQL distributed message system
Based on messages, we create mysql replication platforms , using async message to build strong distributed subscription system.
read this PDF : http://www.louisliu.blog/docs/MySQL_async_message.pdf[……]
招聘帖
因公司业务发展迅速,部门现在招两个mysql dba 同学,目前本人在平安健康互联网(平安好医生)数据团队,负责数据库的整体规划,想来的同学可以发简历到我的邮箱 ylouis83@gmail.com 靠谱的公司靠谱的团队 :)
关于公司:
国内最大的互联网医疗平台,提供全品类互联网医疗服务,目前国内前三大的a轮估值[……]
How to backup remote redis instance
We wrote a python scripts to control redis backup work.
Three Steps to do this work:
1. Create meta database to store which redis instance needs to backup
2. Use scripts to connect to these redis instances with “–rdb” command (remote backup command)
3. Estimate which redis server should[……]
Linux tools part 11 – Monitoring specified file-IO
We could use inotify-tools to monitor file or directory IO state
yum install inotify-tools
#inotifywait -m /storage/sas/mysql3306/data/diablo_im/#sql-ib4747-2643139248.ibd
Setting up watches. Watches established.[......]
TokuDB benchmark on PCIe
MariaDB TokuDB benchmark on FusionIO ,Compare TokuDB and InnoDB engines.
read: TokuDB_benchmark[……]