Data Engineer
idfcfirst.bank
|
Experience: 3+ Years
|
Thane
|
Posted 1 hours ago
Job Description
- Build, manage and automate the AWS cloud platform to support scalable and highly available data-processing workloads.
- Create and maintain end-to-end continuous integration and continuous delivery pipelines using Jenkins and other relevant tools.
- Manage source code through Git and support controlled production deployments.
- Work with Data Engineering and Analytics teams to set up, monitor and optimise daily business-processing pipelines.
- Support infrastructure management, operational controls and audit requirements for the cloud platform.
- Collaborate with development teams to identify and document high-impact business use cases and potential technical solutions.
- Develop automation scripts using shell scripting and Python.
- Prepare technical design documentation for projects, automation workflows and data pipelines.
- Contribute to the delivery and presentation of technical solutions to relevant stakeholders.
- Troubleshoot platform, deployment and pipeline issues and implement preventive improvements.