Senior Data Engineer
Job Description
7+ years of hands-on experience using DBT. Airflow, Azure Databricks, Python, Py-spark and SQL , Preferred from
Healthcare & Fintech Domain having Automation First Mindset.
· Hands-on experience with Data Collection, Data Analysis, Data modeling, Data Processing using DBT, Airflow, Azure
Databricks, Py-spark, SQL, Python.
· Performance Optimization and Automation: Continuously monitor and optimize existing solutions and Debugging DAG failures and resolving.
· Data Processing: Leverage his expertise building Robust Data pipelines using mentioned tech stack with CI/CD.
· Collaboration: Collaborate with cross-functional teams, including data scientists, business analysts, and stakeholders, to understand their data needs and deliver solutions.
· Data Quality: Implement data validation and cleansing processes to ensure data accuracy, consistency, and reliability.
· Influence: bring right solution for use cases and convince the team to use.
· Open to Ad hoc Data Analysis and Reporting/Dashboard Development: Perform exploration data analysis, develop data visualizations, and generate actionable insights to support business decision-making.
· Stay Current: Stay up to date with emerging trends and technologies in data engineering and analytics and make recommendations for their adoption.