Data Platform Administrator

We are seeking a skilled and proactive Data Platform Administrator to manage, monitor, and optimize our cloud data platform environment. The ideal candidate will have hands-on experience with cloud-based data platforms, strong knowledge of Spark, big data or related technologies, and a passion for enabling data teams to work efficiently and securely. Key Responsibilities- Platform Administration Handle and maintain workspaces, clusters, pools, and jobs in Databricks or other big data systems. Monitor performance, usage, and costs; optimize cluster configurations. Security & Compliance Configure role-based access control (RBAC), and audit logging. Ensure compliance with data governance and security standards. Automation & DevOps Develop CI/CD pipelines for notebooks, jobs, and libraries using tools like Gitlab, GitHub Actions, Azure DevOps, or Jenkins. Automate cluster lifecycle management and job scheduling. Support & Troubleshooting Provide support to the users of the platform i.e., data scientists, engineers, and analysts. Troubleshoot job failures, performance bottlenecks, and integration issues. Integration & Collaboration Integrate Databricks with other enterprise systems (e.g., Azure Data Lake, Power BI, Dataverse). Collaborate with data eng Required Qualifications Proven experience administering big data platforms in a production environment. Strong understanding of Apache Spark and distributed computing. Experience with cloud platforms (Azure preferred, AWS or GCP acceptable). Familiarity with Unity Catalog, Delta Lake, and Lakehouse architecture. Proficiency in Python, SQL, and shell scripting. Experience with CI/CD tools and infrastructure-as-code (Terraform is a plus). Excellent problem-solving and communication skills. About us: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs. It’s how we’ve contributed to supporting the financial stability and growth of communities and economies globally for more than 300 years. Through a comprehensive suite of trusted financial market infrastructure services – and our open-access model – we provide the flexibility, stability and trust that enable our customers to pursue their ambitions with confidence and clarity. LSEG is headquartered in the United Kingdom, with significant operations in over 60 countries across EMEA, North America, Latin America and Asia Pacific. We employ 25,000 people globally, more than half located in Asia Pacific. Join us and be part of a team that values innovation, quality, and continuous improvement.