Senior Developer
About this role
Job Summary
As Data Engineer within the squad, collaborating with Business Analysts, Developers, Testers, and stakeholders to understand requirements and deliver scalable data solutions. Day-to-day responsibilities include developing and enhancing data pipelines, writing transformation SQL queries, performing data validation and quality checks, troubleshooting data issues, supporting testing activities, and participating in sprint ceremonies and technical discussions. Work closely with L1 Operations to investigate and resolve production incidents, ensuring timely issue resolution and stable data processing. Also maintain Confluence documentation covering processes, data flows, and technical solutions, while managing delivery timelines, dependencies, and cross-team coordination. Additionally, contribute to identifying and driving AI-based automation opportunities to improve operational efficiency and reduce manual effort.
Key Responsibilities
- Developing and enhancing data pipelines and SQL-based data processing solutions.- Analysing business and technical requirements, assessing upstream and downstream impacts, and identifying delivery dependencies and risks.- Performing data validation, reconciliation, troubleshooting, and root-cause analysis to ensure data accuracy and reliability.- Supporting functional, integration, regression, and production validation activities.- Working with L1 Operations to investigate and resolve production failures and incidents within agreed timelines.- Providing release and post-release support to ensure smooth deployments and platform stability.- Creating and maintaining Confluence documentation covering technical processes, data flows, operational procedures, and support guidance.- Participating in sprint planning, daily stand-ups, refinement sessions, retrospectives, and technical discussions.- Managing delivery timelines, coordinating cross-team dependencies, and proactively communicating risks, issues, and blockers.- Identifying opportunities to automate manual activities, including leveraging AI-assisted solutions to improve operational efficiency and reduce manual effort.
Skill Requirements
Omnia Spark ETL, Ab Initio, , Scala, Python, Shell Scripting, AWS Glue, Amazon Redshift, Amazon Athena, Airflow, SageMaker, ComputeHub, Neo Ingestion, EventHub, SQL, MySQL, Oracle Developer, Teradata SQL Assistant, Jenkins, TeamCity, GitHub Actions, Git, GitHub, Git Bash, Alation, Hue, Autosys, ServiceNow, XLR, Jira, IntelliJ IDEA, Visual Studio Code, GitHub Copilot, SDLC, Agile/Scrum, Production Support, Release Management, Code Review, Data Quality & Validation
Other Requirements