Data Engineer

Duties and Responsibilities

• Develop, test, monitor, and optimize end-to-end data processing jobs and workflows, covering data acquisition, transformation, and data exposure/publishing.
• Design, develop, and enhance applications, solutions, or software that consume data from the data lake/data warehouse for visualization and advanced analytics (e.g., reports and dashboards).
• Build, test, and maintain big data architecture and open-source databases (e.g., Hadoop, Hive, HBase, Presto), including supporting the development and deployment of innovative big data platforms.
• Establish and enforce controls on data being collected, processed, transformed, and presented. Perform regular audits on data quality (accuracy, completeness, timeliness) and ensure compliance with PLDT Group standards.
• Collaborate and communicate regularly with business users, ...