Data Engineer (In Partnership with IMDA)
Responsibilities: Understand each data point nature, flow & underlying technologies needed to collect the data Design and implement data pipelines to collect, clean, and transform customer interaction data. Develop data storage solutions to accommodate large volumes of data. Ensure data quality and integrity throughout the system. Develop the centralized logging platform, including APIs and integrations with various systems. Ensure the system’s scalability, performance, and security. Implement real-time processing capabilities using technologies like Apache Kafka and SQL Server CDC etc. Work with data analysts and scientists to analyse customer data to identify trends, patterns, and anomalies. Collaborate with business teams to