Lead Data Platform Engineer
Location:
Phoenix , Arizona
Posted:
November 24, 2017
Reference:
37769
Do you want to be on the forefront of the next BIG thing in advancing the analytic technology landscape? Are you driven by the thought of being involved at the ground level of an enterprise wide transformation? Do you enjoy solving complex business problems in a fast paced, collaborative environment?

Discover Financial Services is seeking a bright, driven, and talented individual to join a team of passionate and innovative technologists.

*** THIS POSITION CAN BE BASED AT OUR PHOENIX LOCATION OR AT OUR HEADQUARTERS IN RIVERWOODS, IL***

In this role, you will use your experience and hands on approach with next generation technologies to contribute to a team that delivers the latest streaming & next generation data technologies.

Responsibilities:
*Contributing member of a high performing, agile team focused on next generation data & analytic technologies
*Hadoop administration including building, supporting, performance tuning and monitoring clusters in an enterprise production environment
*Engineering and integrating Hadoop modules such as YARN & MapReduce, and related open source projects such as Hive, HBase, Pig into the data analytic ecosystem.
*Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm, NIFI and Kafka
*Manage NoSQL databases like HBase, Cassandra and MongoDB
*Assist application development teams during application design and development for highly complex and critical data projects
*Operationalization of open source data analytic tools such as Spark, Python and R for enterprise use
*Building efficient data platform for structured and unstructured data
*Utilizing programming languages like Java, Spark, Python with an emphasis in tuning, optimization and best practices for application developers
*Operationalize data management and governance tools on an open source framework
*Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilities
*Industry experience in Financial Services or other regulated industries
*Hands on experience leading delivery through Agile methodologies
*Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to require standards and processes.
Skills
*Bachelor's Degree
*5+ years' work experience
*3+ years Linux/Unix including basic commands, shell scripting and solution engineering
*1+ years Hadoop administration
*2+ years' experience with various tools and frameworks that enable capabilities within the data ecosystem (Hadoop, Kafka, NIFI, Hive, YARN, HBase, NoSQL)
*Experience developing software solutions to build out capabilities on a Big Data and other Enterprise Data Platforms
*Experience with solving problems and delivering high quality results in a fast paced environment
*Experience with NIFI specifically with developing custom processors and workflows
*Experience managing NOSQL databases such HBASE , Casandra, MongoDB
*Expertise in coding in Python, Hive, R, Spark, Java with emphasis on tuning / optimization
*Experience developing data solutions on AWS
*Experience designing, developing, and implementing ETL and relational database platforms
*Experience working with automated build and continuous integration systems (Chef, Jenkins, Docker)
*Experience managing code on Github
*Experience with data mining, machine learning, statistical modeling tools or underlying algorithms

About Us
Since Discover launched in 1986, we've made a business of redefining the credit card industry for the better. We were first to have no annual fee, first to offer cash rewards, first to provide 24/7 customer service, and we rank #1 in customer loyalty. As a Fortune
500 company, we strive to provide our employees with an environment where they can contribute in a way that's different from other large institutions. If you're looking for a place to make a difference and let your voice shine through, we'd love to meet you.

Apply today at discover.com/careers.

Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability.

#LI-KB1 We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.

A little about us:
Discover is one of the most recognized brands in U.S. financial services. We’re a direct banking and payment services company built on a legacy of innovation and customer service.

Know someone who would be interested in this job? Share it with your network.