Senior Data Engineer
Job Description
Enterprise Data Architecture
-
Design and maintain enterprise data architecture that aligns with business strategy and technology roadmaps.
-
Define logical, conceptual, and physical data models across operational and analytical platforms.
-
Develop scalable architecture patterns for data lakes, data warehouses, lakehouses, and modern analytics platforms.
-
Establish standards for metadata, lineage, master data, reference data, and data lifecycle management.
-
Drive technology evaluations and architectural decisions for cloud-based data platforms.
Data Platform Engineering
-
Design, build, and optimize enterprise data platforms using cloud-native technologies.
-
Develop and maintain scalable ETL/ELT pipelines for structured and semi-structured data.
-
Implement infrastructure automation and deployment pipelines using Infrastructure as Code and CI/CD practices.
-
Optimize platform performance, reliability, scalability, and cost across cloud environments.
-
Troubleshoot platform issues and continuously improve operational resilience.
Data Governance & Security
-
Design and implement enterprise data governance frameworks.
-
Lead initiatives involving confidential data identification, classification, masking, tokenization, encryption, and access control.
-
Define and implement data retention, auditing, and compliance standards.
-
Collaborate with Security, Risk, Legal, and Compliance teams to ensure adherence to regulatory requirements.
-
Establish enterprise metadata management and data lineage capabilities.
Data Quality & Reliability
-
Develop enterprise data quality frameworks including validation, reconciliation, completeness, accuracy, and monitoring.
-
Implement automated quality controls within ingestion and transformation pipelines.
-
Define KPIs and metrics to measure platform health and data quality.
-
Lead initiatives that improve trust in enterprise data assets.
Cloud Platform Administration
-
Administer enterprise analytics platforms including Databricks, Microsoft Fabric, Snowflake, Azure and AWS environments
-
Manage workspace provisioning, Unity Catalog governance, compute optimization, storage management, and platform security.
-
Implement role-based access controls and least-privilege security models.
-
Monitor platform utilization, capacity planning, and cost optimization.
Analytics Enablement
-
Partner with BI teams to enable trusted enterprise reporting.
-
Support semantic models, reporting platforms, and self-service analytics capabilities.
-
Ensure data products are discoverable, reusable, and governed.
Architecture Leadership
-
Lead architecture reviews and technical design sessions.
-
Provide technical leadership to engineering teams and mentor junior architects and engineers.
-
Define enterprise best practices, standards, and reusable design patterns.
-
Review solution designs for scalability, maintainability, security, and performance.
Operational Excellence
-
Improve platform reliability through monitoring, automation, observability, and incident response.
-
Develop operational runbooks and disaster recovery strategies.
-
Drive continuous improvement initiatives across platform operations.
-
Support production deployments and release management.
Cross-Functional Collaboration
-
Partner with Finance, HR, Operations, Product, Security, and Engineering teams to understand business requirements.
-
Translate business objectives into scalable technical solutions.
-
Communicate architecture decisions and technical strategy to both technical and executive audiences.
-
Lead cross-functional initiatives involving multiple business units and external vendors.
-