We created a project called LC (log center) for ops department
All member of ops are using this system for analyzing in a lower layer.
We collects all types of log including db-system, crond, secutiry log , cmdlog , api log etc.
We used MQ system for log push which based on a policy center. And[……]
MySQL special character rollback
Actually, Mysqlbinlog tools can’t miner mysql binlog exactly correct.
In this post ,a special environment we got may hexadecimal characters what we don’t need.
Read this PDF: Special-code-rollback.pdf [……]
[JKDB] BACKUP AND RESTORE
JKDB PLATFORM – our company’s data management platform
In this post, we introduce backup-restore module,focus on automatic backup and restore in a huge MySQL database environment.
Read this PDF: JKDB:BACKUP-RESTORE[……]
Facebook WDT Test
Log-Center for OPS
We build a strong log-collection system to analyze total logs of our operation teams (including system ,database, web service ,load balance ,audit, cache system , hardware, iDrac logs). All of these logs are used to build a high streaming log system to find a particular performance point of our apps[……]
Donkey – system for MySQL automatic maintenance
We build this system based on Inception (Qunar)。
All of MySQL DDL/DML operations are based on Donkey system, with strict approval process to keep online system strong and available.
Open this file by Mockplus Donkey-system[……]
TCP Trace
I found a useful tool named sniffer to help us analyze network packages (this tool can capture packages on specific port)
I use sniffer to analyze mysql and redis packages (translate these packages to normal queries)
#./vc-redis-sniffer –help
vc-redis-sniffer is a utility from VividCortex[......]
MySQL TCPCOPY
Infiniflash Benchmark
Sandisk (FusionIO) and Nexenta are working together to build this SDS solution.
Infiniflash is a very large SDS production, which manages for very large DW system who requires large storage space and also high IOPS.
We test infiniflash system ,read this Infiniflash_benchmark[……]
MySQL distributed message system
Based on messages, we create mysql replication platforms , using async message to build strong distributed subscription system.
read this PDF : http://www.louisliu.blog/docs/MySQL_async_message.pdf[……]