MasterCard Senior Engineer, Big Data Engineering (Hadoop Admin) in O'Fallon, Missouri
Who is Mastercard?
We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless ®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
Senior Engineer, Big Data Engineering (Hadoop Admin)
Purpose of the Team:
o Provide strategic direction and expertise to all of MasterCards Big Data environments.
o Provide Big Data hands-on support, thought leadership and technology roadmaps to support MasterCards vision and evolution.
Purpose of the Job:
o Assume a lead position in providing strategic direction, evaluation and recommendation of Big Data products to support MasterCards current and future vision of Big Data.
o Represent Big Data Engineering alongside business partners to provide expertise that supports significant M&A, strategic and new technology infrastructure.
o Design and implement large scale data migration and data processing on Hadoop using massively parallel processing programming (MPP) techniques.
Essential responsibilities of the position:
Work directly with application and development teams to completely understand requirements for project and ad hoc requests and provide accurate estimates.
Support mission-critical Big Data environments for highly-available and contingent platforms.
Create and maintain documentation and define best practices in support of proper change management, security and operational requirements.
Investigate and understand new technologies and additional capabilities of current platforms that support MasterCards vision of Big Data, leading their delivery adoption.
Provide maintenance and operational support activities related to Big Data platforms per MasterCard standards and industry best practices.
All About You
Essential knowledge, skills and experience:
o Strong knowledge of Hadoop platforms and other distributed data processing platforms.
o Advanced Linux knowledge is a must. Understanding of shell, debugging, etc.
o Strong background in delivering mission-critical Big Data project work while interacting with diverse and experienced teammates across the spectrum of enterprise operational functions.
o Strong problem solving skills and able to engage in troubleshooting complex problems which require coordination across multiple teams.
o Experience with CI/CD (continuous integration / continuous integration) and infrastructure automation tools and techniques.
Desirable or additional capabilities:
o SQL knowledge a must. Experience with advanced data warehousing and MPP knowledge is a plus.
o Understanding of and experience with network engineering in support of large IT organizations.
o Background building and maintaining extract/transform/load (ETL) processes. Practical experience dealing with large ETL pipelines is a plus.
o Experience building and maintaining Big Data technologies on public or private cloud technologies.
Mastercard is an inclusive Equal Employment Opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
If you require accommodations or assistance to complete the online application process, please contact firstname.lastname@example.org and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.
Requisition ID: R-71879