Manager, Data Engineer

  • Company: Capital One
  • Location: New York, New York
  • Posted: August 17, 2016
  • Reference ID: R9209
114 5th Ave (22114), United States of America, New York, New York

Manager, Data Engineer

Do you want to change the way the world interacts with their money? Do you have the desire to work and learn alongside some of the best engineers in the industry?
Do you have an opinion on the future of stream versus batch processing? 

Then we want you! 

As part of our team, what will you do? You will be passionate and driven to create the world’s best consumer banking experiences AND you will:
- Write code (delivering solutions for storing, exporting, manipulating, and analyzing data at scale)
- Demand quality (improving our data operations and analytics through automation)
- Collaborate (working closely with product owners and other engineers to gather, share, and use data to drive product decisions)
- Learn (solving product development challenges through the introduction of new and emerging tools and approaches to data)
- Passion for data-driven insights and innovations

Here is what we will bring to the table:

- A startup mindset with the backing of a top 10 bank
- Monthly Innovation-Days dedicated to test driving cutting edge technologies
- Flexible work schedules - Convenient office locations - Generous salary and merit-based pay incentives
- Your choice of equipment (MacBook/PC, iPhone/Android Device)

Here is what we would like you to bring to the table:

We are looking for driven individuals to join our team of passionate data engineers in creating Capital One’s next generation of data products and capabilities.
- You will build data pipeline frameworks to automate high-volume and real-time data delivery for our Hadoop and streaming data hub
- You will build data APIs and data delivery services that support critical operational and analytical applications for our internal business operations, customers and partners
- You will transform complex analytical models into scalable, production-ready solutions
- You will continuously integrate and ship code into our on premise and cloud Production environments
- You will develop applications from ground up using a modern technology stack such as Scala, Spark, Postgres, Angular JS, and NoSQL
- You will work directly with Product Owners and customers to deliver data products in a collaborative and agile environment

- Develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business Customers
- Ability to grasp new technologies rapidly as needed to progress varied initiatives
- Break down data issues and resolve them
- Build robust systems with an eye on the long term maintenance and support of the application
- Leverage reusable code modules to solve problems across the team and organization
- Utilize a working knowledge of multiple development languages
- Drive cross team design / development via technical leadership / mentoring
- Understands complex multi-tier, multi-platform systems

- Bachelor’s Degree or military experience
- At least 5 years in coding in data management, data warehousing or unstructured data environments
- At least 5 years experience with leading big data technologies like Cassandra, Accumulo, HBase, Spark, Hadoop, HDFS, AVRO, MongoDB, Zookeeper

- Master's Degree
- 3+ years experience with Agile engineering practices
- 3+ years in-depth experience with the Hadoop stack (MapReduce, Pig, Hive, Hbase)
- 3+ years experience with NoSQL implementation (Mongo, Cassandra, etc. a plus)
- 3+ years experience developing Java based software solutions
- 3+ years experience in at least one scripting language (Python, Perl, JavaScript, Shell)
- 3+ years experience developing software solutions to solve complex business problems
- 3+ years experience with Relational Database Systems and SQL
- 3+ years experience designing, developing, and implementing ETL
- 3+ years experience with UNIX/Linux including basic commands and shell scripting

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position

Share this Job