Staff Enterprise Data Engineer
trinet
|
Experience: 8+ Years
|
Hyderabad
|
Posted 14 hours ago
Job Description
- Create, maintain, and optimize data pipelines from development to production for specific use cases.
- Use innovative and modern tools, data services, techniques, and well architected frameworks to automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
- Assist with optimizing the data management infrastructure to drive automation in data integration and management.
- Implementing and using modern data preparation, integration and AI-enabled metadata management tools and techniques. Including MLOps framework and infrastructure automation.
- Tracking data consumption patterns
- Performing intelligent sampling and caching
- Monitoring schema changes
- Recommending — or sometimes even automating — existing and future integration flows.
- Collaborate in close relationship with data science teams and with business (data) analysts in refining their data requirements for various data and analytics initiatives and their data consumption requirements.
- Build, model and curate data lake/warehouse and other data consumption methods.