Sr. Hadoop Site Reliability Engineer
Posted: December 17, 2016
Reference ID: 1928754524
LinkedIn was built to help professionals achieve more in their careers, and every day millions of people use our products to make connections, discover opportunities and gain insights. Our global reach means we get to make a direct impact on the world's workforce in ways no other company can. We're much more than a digital resume - we transform lives through innovative products and technology. Searching for your dream job? At LinkedIn, we strive to help our employees find passion and purpose. Join us in changing the way the world works.
We're seeking a solid engineer to administer/scale our multi-petabyte Hadoop clusters hosted in our data centers and the related services that go with it. At LinkedIn, Hadoop is used by thousands of users who run millions of jobs to power data products like PYMK (people you may know), JYMBII (jobs you may be interested in), etc. This role focuses primarily on provisioning, ongoing capacity planning, management of servers and application/middleware that run on Hadoop as per requirements established in collaboration with the Data and Analytics Infrastructure teams.
Responsible for the implementation and ongoing administration of Hadoop infrastructure including monitoring, tuning and troubleshooting. Design, implement and maintain security, data capacity, node forecasting and planning. Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment. Closely work with the Hadoop development, infrastructure, network, database, and business intelligence teams. Participate in a 24x7 rotation for production issue escalations. Communicate effectively with people at all levels of the organization.
Experience in deploying/configuring core Apache Hadoop and related infrastructure. Experience in tools integration, automation, configuration management systems. Experience with networking, systems administration skills. 3+ years of experience on Hadoop infrastructure stack. 2+ years of experience in a scripting language. BA/BS degree in Computer Science or related technical discipline, or equivalent practical experience.
5+ years of hands on working experience on Hadoop infrastructure stack (Ex: HDFS, MapReduce, HBase, Flume, Spark, Pig, Hive, Oozie, YARN, Zookeeper, Presto, etc). 2+ years of experience in Python or Perl.