Senior Data Engineer

About the company

Trust Wallet is the secure, self-custody Web3 wallet that empowers people to own and control their digital assets. Whether you're new to crypto or an experienced user, Trust Wallet makes it easier, safer, and more convenient to explore Web3, securely access dApps, manage your crypto, and buy and sell digital assets, all in one place.

ABOUT THE ROLE

As a Senior Data Engineer, you will play a key role in building and scaling the data platform that powers analytics across Trust Wallet. You'll be responsible for designing, developing and maintaining data pipelines and data models, ensuring a seamless, scalable and reliable flow of data from source systems through to the decisions it supports. Leveraging your experience with Databricks and Spark across both streaming and batch workloads, dbt or a similar transformation framework, cloud infrastructure, and custom solutions in Python, you'll work closely with our data analysts and engineering teams to turn data into a strategic asset for our company.

KEY RESPONSIBILITIES

- Data Platform Engineering: Architect and maintain robust, scalable and secure data infrastructure on Databricks, covering both streaming and batch workloads.

- Data Pipeline Development: Design, develop and maintain data pipelines, primarily in Python and Spark, to automate ingestion and transformation across internal systems, external providers and on-chain sources.

- Data Modelling: Design and maintain dimensional data models and transformation layers in dbt, with tests and documented contracts, so metrics are consistent and reusable across the company.

- Data Lake Management: Oversee the data lake and lakehouse layers, ensuring efficient storage, effective partitioning, high data quality, and monitoring and alerting that surfaces issues early.

- Integration and Customisation: Integrate Databricks with a wide range of data sources, including change data capture from operational databases, third-party APIs and blockchain data, and adapt data flows to specific business needs.

- Performance, Scalability and Cost: Optimise pipelines and storage for performance, reliability and cost efficiency at scale.

- Data Governance and Security: Apply best practices for governance, security and compliance in cloud and Databricks environments, including access control, encryption and monitoring.

- Collaboration and Documentation: Work closely with platform engineers, data analysts and other stakeholders to understand data requirements, and document infrastructure, models and best practices.

REQUIRED QUALIFICATIONS

- Experience in Data Engineering: 3+ years as a Data Engineer, with hands-on ownership of production pipelines and lakehouse or data warehouse architecture.

- Databricks and Spark: Strong practical experience with Databricks, Delta Lake and Spark, including both streaming and batch processing, and the judgement to choose between them.