Lead Data Engineer, Tech College
Location:
Posted:
October 28, 2016
Reference:
R13367
Towers Crescent (12066), United States of America, Vienna, Virginia

Lead Data Engineer, Tech College

At Capital One, data is at the center of everything we do. When we launched as a startup we disrupted the credit card industry by individually personalizing every credit card offer using statistical modeling and the relational database, cutting edge technology in 1988! Fast-forward a few years, and this little innovation and our passion for data has skyrocketed us to a Fortune 200 company and a leader in the world of data-driven decision-making.  We may be a bank, but we think and operate like a tech company. A tech company that writes its own code, develops its own software, and builds its own products. A tech company that experiments and innovates with the latest technologies, engineers breakthrough customer experiences, and brings simplicity and humanity to banking.

As a Data Engineer at Capital One, you’ll be part of a team that’s leading the next wave of disruption at a whole new scale, using the latest in distributed computing technologies and operating across billions and billions of customer transactions to unlock the big opportunities that help everyday people save money, time and agony in their financial lives.  You’ll be part of a team responsible for analyzing, designing, and developing highly engaging learning solutions that will fuel our growth as a Tech company and help our associates develop cutting-edge Tech skills within the data science discipline. You will participate in detailed technical design, development and implementation of applications using existing and emerging technology platforms. Working within an Agile environment, you will provide input into architectural design decisions, develop code to meet story acceptance criteria, and ensure that the applications we build are always available to our customers. You'll have the opportunity to mentor other engineers and develop your technical knowledge and skills to keep your mind and our business on the cutting edge of technology.  At Capital One, we have seas of big data and rivers of fast data.  To tame it all we're using tools like Spark, Scala, Akka, Cassandra, Accumulo, HBase, Hadoop, HDFS, AVRO, MongoDB, and Mesos – and we're on the look-out for anything else that will help us.  

Responsibilities:
- Lead and develop sustainable data driven solutions with state-of-the-art technologies to meet the needs of our organization and business customers
- Design robust systems with an emphasis on reliability, fault tolerance, durability, and availability
- Leverage reusable code and modules to solve problems across the team and organization
- Exhibit mastery in at least one of the following domains: 
- distributed batch and stream compute platforms
- distributed database and storage technologies
- Be capable of handling multiple functions and roles within a single project or team
- Follow, build, and demand strong software engineering principles across the team
- Be a self-motivated, driven individual with strong emphasis on team accountability
- Establish or maintain best practices across the team and organization where appropriate
- Document and disseminate knowledge to team members and the wider organization
- To develop, understand, and reason about large frameworks and bodies of code


Basic Qualifications:

- Bachelor’s Degree or military experience
- At least 3 years developing data driven products and solutions 
- At least 2 years experience developing with open source projects
- At least 5 years experience developing in Java or C++
- At least 2 years experience with distributed systems
- At least 2 years of experience with Unix/Linux systems with scripting experience in Shell, Perl or Python

- At least 1 year experience with leading big and fast data technologies like Spark, Scala, Akka, Cassandra, Accumulo, Hbase, Hadoop, HDFS, AVRO, MongoDB, Mesos

Preferred Qualifications:
- Master's Degree in fields of Computer Science, or Computer Engineering, or Data Science, or similar military experience

- 3 years experience in git or related version control systems
- 3 years experience in distributed data technologies 
- 2 years of experience with Agile engineering practices
- 3 years experience with distributed NoSQL data stores 
- 1 years experience with graph database technologies 
- 5 years experience with Relational Database Systems and SQL
- 5 years experience designing, developing, and implementing ETL pipelines
- 5 years of experience providing technical leadership on relevant applications

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.

A little about us:
Headquartered in McLean, Virginia, Capital One® offers a broad array of financial products and services to consumers.

Know someone who would be interested in this job? Share it with your network.