Data Engineer
wtwco
|
Experience: 5+ Years
|
Kolkata
|
Posted 4 hours ago
Job Description
- Build and maintain scalable pipelines with Azure Databricks, Python, and PySpark.
- Orchestrate data movement and workflows with ADF pipelines, triggers, and integration runtimes.
- Ingest and transform large datasets from sources such as SQL Server and Oracle.
- Manage data governance and access control with Unity Catalog.
- Implement cloud-native data solutions following best practices, with experience in the Azure or AWS cloud.
- Monitor, troubleshoot, and tune pipelines for performance and reliability; take part in the on-call rotation.
- Turn business requirements into robust data solutions and support production releases.
- Maintain documentation and runbooks.