Sr. Software Engineer

Core Services Engineering builds and manages the critical products and services that Microsoft runs on. We boldly pursue big ideas that power transformational advances at Microsoft and for our customers, while helping Microsoft teams work smarter, faster and more securely every day. Core Services Engineering employees have deep technical and business expertise, customer insights, and a clear point of view that comes from first-hand, large-scale experience with Microsoft and industry solutions. We are engineers, technology leaders and experts, digital transformation change agents, and customer advocates.

We have exciting opportunities for you to innovate, influence, transform, inspire and grow within our organization and we encourage you to apply to learn more!

Are you excited about Big Data and Distributed Processing? Do you love figuring out how to apply the Apache Spark techniques? Are you passionate about working on finance data with complex business logic?

We’re looking for an experienced Data Engineer who is enthusiastic about transforming data into action.

As a Software Engineer for Corporate Functions Engineering Finance, you will work on finance data to give deep insights to customers. It's your chance to:

• Demonstrate strong interpersonal and communication skills, while working with diverse audiences including highly technical professionals, developers, architects and finance business process managers.
• Understand complex business requirements.
• To read complex T-SQL procedures to understand the existing process
• Create new process in Apache Spark using Scala
• Create orchestrations for different Spark jobs.
• Create data marts for specific reporting requirements.
• Collaborate with other technical teams at Microsoft to deliver product and solution level support.

Skills and qualifications:
• 5+ years of industry experience with Microsoft Server products, and Azure Platform technologies.
• Demonstrable experience developing real-world Big Data solutions (Java, Scala) on Windows/Linux.
• Big Data and Analytics platform: HDInsight (Hadoop, Spark, HBase).
• Practical knowledge of common storage options including JSON, Parquet and ORC formats.
• Working experience with Azure platform is strongly preferred/required
• Working knowledge of Azure PowerShell.
• Solid knowledge of the Hadoop ecosystem on one or more major distros (Horton Works, Cloudera)
• Troubleshooting tools and techniques and data analytics jobs and workflows.
• Use trace analysis, debug skills, source code, and other proprietary tools, to analyze problems and develop solutions to meet customer needs; this may involve writing code.
• Solid understanding of client/server, networking, and Internet technologies fundamentals.
• Understanding of n-tier solutions.
Nice to have skills include any tools/technologies in the Spark related ecosystem (YARN, Livvy, Zookeeper, Kafka, etc.)

Key Skills & Knowledge:
• Minimum 2 years of hands-on experience working on Big Data solutions in production using Apache Spark and related technologies
• Candidates should have prior experience with Linux platform on Azure and Hadoop
• Strong problem-solving and technical leadership skills
• Works well in a global team environment
• Excellent Communication and presentation skills
• Effective learning skills, desired background in Microsoft technologies

Basic Qualifications
• 7+ years of experience with C# or Java
• 5+ years of relational or NoSQL database experience
• 5+ years of experience in software development
• 3+ years of experience working with BI, Big Data/ Data Science or Machine Learning technologies
• Bachelor's degree in Computer Science

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to