Data Engineer II

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer II Overview We are looking for a Data Engineer to join the Data Engineer team. This is a pivotal role, responsible for supporting multiple Data Analysts and Data Scientists day-to-day and assisting various data-driven requests across the company. The position involves a wide variety of technical skills, from coding to infrastructure, from data analysis to database management. The ideal candidate will have experience working with large-scale data and building automated data ETL processes for large-scale data analysis. ODS or data warehousing experience would be ideal. Key responsibilities include: • Build and maintain database technologies, environments, and applications, seeking opportunities for improvements and efficiencies • Should be familiar and have experience in cloud data platforms like Databricks and/or Cloudera, Iceberg/Delta tables • Writes SQL statement procedures to optimize SQL execution and query development • Effectively utilizes various technology like Spark (Scala, Python), Apache Kafka, Trino • Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables • Leads database security posture, which includes proactively identifying security risks and implementing both risk mitigation plans and control functions • Supports process improvement efforts to identify and test opportunities for automation and/or reduction in time to deployment • Participating in the entire solution development cycle from requirement gathering to solution deployment. • Working with multiple stakeholders across teams to fulfill ad-hoc investigations, including large-scale data extraction, transformation, and analyses. • Supporting production code to produce comprehensive and accurate data artifacts. • Promoting strategies to improve our data modeling, quality, and architecture. All About You: Should have experience working with Databricks and/or Cloudera platforms Skilled in Spark framework (Scala/Python), Apache Kafka, Spark Streaming Highly skilled in SQL knowledge and relational databases. Experienced with developing and maintaining data pipelines for the extraction, transformation, and/or loading of large-scale data. Experienced with working with large data sets. You’ve implemented parallel processing and have dealt with the limitations and challenges of working with terabytes of data. Strong analytics skills related to working with unstructured datasets.