Senior Data Engineer

• ABOUT THIS ROLE

   

  Apex Fintech Solutions is seeking a Senior Data Engineer to play a key role on our Billing engineering team, responsible for designing, developing, and maintaining high-quality software solutions. You will leverage your experience and expertise to contribute to the software development lifecycle, from requirements analysis and implementation to testing and deployment. You will collaborate with team members and cross-functional partners to deliver scalable, reliable, and efficient software products that meet the needs of our users and business objectives.

   

  Duties/Responsibilities

  • Design and maintain data pipelines for the classic billing system using Python and MS SQL Server, including ETL processes, data transformations, stored procedures, and scheduled jobs to support financial reporting and reconciliation workflows

  • Build and optimize SQL queries and database objects in MS SQL Server for the legacy system, writing complex queries, views, indexes, and stored procedures to support billing operations, reporting requirements, and data quality checks

  • Develop Python-based automation and data processing scripts to integrate the classic system with modern platforms, handling data extraction, transformation, validation, and loading between MS SQL Server and cloud-based systems like BigQuery and PostgreSQL

  • Support data migration and modernization efforts from the classic billing system to the new microservices platform, designing data mapping strategies, building migration tools, and ensuring data integrity across systems during the transition

  • Create and maintain data quality monitoring, implementing validation checks, reconciliation processes, and alerting mechanisms to ensure accuracy and consistency of billing data across both classic and modern systems

  • Collaborate with engineering and finance teams to understand data requirements, provide data insights for billing calculations and settlements, and support ad-hoc analysis and reporting needs using SQL, Python, and BI tools

  • Document data schemas, pipelines, and processes for both classic and modern systems, creating technical documentation, data dictionaries, and runbooks to support system knowledge transfer and operational continuity

   

  Education and/or Experience

   

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent work experience) required; advanced degree preferred

  • 5+ years of experience in software development with a strong proficiency in one or more programming languages, including Java, Python

  • Experience with automated testing frameworks and methodologies for backend services

  • Experience contributing to epics and participating in technical direction and implementation strategy for projects

  • Experience with CI/CD (Continuous Integration/Continuous Deployment) pipelines and tools, automating build, test, and deployment processes

  • Experience with cloud platforms (e.g., AWS, Azure, GCP)

  • Experience with SQL including the ability to write complex queries and optimise database performance, e.g. Postgres, MS SQL Server

  • Experience in financial services a plus

   

  Required Skills/Abilities

   

  • Ability to troubleshoot production systems, diagnose issues, and implement effective solutions to ensure system reliability and availability

  • Strong problem-solving abilities, analytical thinking, and attention to detail

  • Effective communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and contribute to technical discussions

  • Knowledge of Agile software development methodologies and tools (e.g., Scrum, Kanban, Jira)

   

  Work Environment

  • This job operates in a hybrid work environment 2 day per week.

   

  #engineering #full-time #mid-senior #LI-DM1 #AFSUK