GCP Data Engineer
persistent
|
Experience: 5+ Years
|
Chennai, Tamil Nadu, India
|
Posted 8 days ago
Job Description
- Design, develop, and maintain scalable data pipelines using Google Cloud Platform (GCP) services.
- Build, optimize, and manage BigQuery data models to support analytical and reporting workloads.
- Develop ETL/ELT processes and data ingestion frameworks for structured, semi-structured, and unstructured data.
- Integrate data from multiple enterprise applications and source systems into a centralized cloud data platform.
- Design and optimize complex SQL queries for data transformation, analytics, and reporting.
- Develop and maintain dashboards and reporting solutions using Looker Studio.
- Monitor data workflows and improve performance through effective schema design, partitioning, clustering, and workload optimization.
- Implement data quality frameworks, validation processes, and monitoring mechanisms.
- Establish and support metadata management, data governance, and lineage tracking processes.
- Utilize Python for data processing, automation, scripting, and API integrations.
- Collaborate with business users, analysts, architects, and engineering teams to understand and implement data requirements.
- Troubleshoot and resolve data-related issues while ensuring availability, reliability, and performance of data platforms.
- Support data platform modernization and continuous improvement initiatives.
- Maintain technical documentation, operational procedures, and engineering best practices.