Data Engineer (Listed Company, Python, Azure)

Key responsibilities

• Optimize, operate at scale and enhance cloud-based data platform on Microsoft Azure (incl DataBricks)

• Involve in cloud data platform enhancement project lifecycle with external vendor including design, development, testing, deployment, and documentation

• Work with Data Analyst to perform data preparation, cleansing, build optimized data models and visualization in Power BI

• Perform proof of concept for cloud data products

• Validate data workflows and integration points through rigorous testing (e.g., pipeline validation, schema checks, and performance benchmarking) to ensure solutions meet business and technical requirements

• Create operational playbooks and automation scripts to streamline deployment, monitoring, and troubleshooting, enabling efficient handover and long-term maintainability of data solutions

• Document data pipeline architecture, deployment processes, and operational runbooks to support effective troubleshooting and post-go-live maintenance by internal teams
  

About you

• Degree in computer science, Information Technology, Data Science or related field

• Related Certification in Cloud Data platform

• 3-4 years working experience related to data platform

• Experience in Python, SQL, Spark, Azure Data Factory, Event Hub / Kafka / Event Messaging, Azure Data Lake Storage Gen2, Databricks, Unity Catalog, Power BI

• Experience in software development lifecycle (SDLC)

• Knowledge of Data & Analytics Multi Tenancy, Data Lakehouse platform architecture, DataOps, MLOps, AIOps, ModelOps and FinOps

• Good command of spoken and written English and Chinese

If interested for the above position, please send detailed resume with current and expected salary as well as date of availability through Apply now.

For more job opportunity, please visit our website: www.clts.com 

The personal information collected is strictly for recruitment purpose only