LiveJournal is looking for a MySQL Database Administrator. We are the 92nd most visited site on the Internet (as measured by Alexa) and the 10th most in Russia. As such, we need a strong team member who is willing and eager to work on scaling and performance issues at this fast-paced and in-demand site.
Work with remote teams on the opposite side of the globe.
Clear, written communication and being able to follow up on tasks without being reminded are a must.
Provide remote engineers enough detail when describing a problem so they have enough information to resolve it without further clarification.
Interface with non-technical team members well enough to understand their issues and communicate resolution.
Share in on-call pager rotation on the order of about one week per month. This means that we also expect you to be capable of performing day-to-day Linux system administrator duties. Almost all of our code is open source and you should be familiar with it.
MySQL - In-depth understanding of MySQL installation, configuration, maintenance and troubleshooting. Knowing the proper way to start replication on a failed slave in a master/master configuration is an absolute must. Be prepared to answer many difficult SQL questions.
Percona - Almost all of our database run Percona. We need a DBA who is familiar with the features it provides, and the differences in the InnoDB architecture that come with this software.
Java - If you know Java, you get serious bonus points. A portion of our infrastructure is based in Java. Having the ability to help with that will probably win us over completely.
Perl - If not Perl, then a comparable language to script common tasks. Perl is preferred.
Automation - we have hundreds of machines and dealing with them by hand just does not scale. Applicants should be familiar with the issues involved in running and maintaining hundreds of machines, and a defendable preference for a popular configuration management tool.
Linux - we run a mix of Debian and CentOS machines. If you have a preference, tell us why. You should consider yourself near-expert level in at least some aspect of configuration, performance monitoring, tuning or package management.
Networking - be familiar with at least the basic concepts of networking and routing.