MasterCard Consultant, Software Engineer (Tech Lead / Hadoop Developer) in O'Fallon, Missouri
Who is Mastercard?
We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless ®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
Consultant, Software Engineer (Tech Lead / Hadoop Developer)
Have you ever wanted to be a part of something BIG? Do you have experience integrating new and emerging technologies into existing environments as technologies evolve and demands change? Are you eager to work with open source software and be exposed to the fast-paced world of Big Data technology? In this role, you can make an immediate impact for a Leading Global Technology Company, MasterCard. The Consultant Engineer role is responsible for working with teams across the company to implement new data solutions while maintaining the stability of the platform. You will be responsible for assessing technologies and approaches for ingestion, transformation and storage. In addition, youll work within the Fraud Data Engineering team to grow their knowledge and expertise. You will get the chance to work with extremely large data sets and be on the cutting edge of transforming the way MasterCard captures, processes, stores and visualizes transactional data.
Develop scalable streaming solutions based on Spark, Kafka and/or Flume
Work closely with ETL technologies such as SyncSort, Informatica, etc.
Work closely with Business Intelligence technologies such as Qlik, Tableau, etc.
Work closely with team members from across Mastercard to identify functional and system requirements
Design, develop and implement data models with quality and integrity at the top of mind to support our products
Create documentation to support knowledge sharing; including flowcharts and diagrams
Provide oversight and guidance to our Data Engineering development team
Developing software utilizing open source technologies to interface distributed and relational data solutions
Work to establish a Hadoop architecture
KNOWLEDGE AND SKILL REQUIREMENTS
BS/BA degree in Computer Science, Information Systems or related field
Experience using ETL technologies and/or Big Data technologies
Understanding of Data architecture, replication, and administration
Experience working with real-time or near real-time ingestion
Strong backend experience using; Python, Scala, HiveQL, SparkSQL, etc.
Deep understanding of high-performant data concepts such as file stores, wide column databases, key-value pairs, etc.
Excellent oral and written communication
Excellent problem-solving skills
OTHER VALUABLE SKILLS
Team Lead Experience
Experience working with the Cloudera stack; Kafka, Spark, Flume, Hadoop, etc
Prior experience w/Business Intelligence Technologies
Equal Opportunity Employer
Requisition ID: R-49950