Data Engineer Lead

About the role

DT One is seeking a highly driven, self-motivated Data Engineer Lead based in Singapore or Manila. Designing, developing, and maintaining a data and AI platform that works at scale. Collaborate with Engineering Leads, Engineers, Data Scientists, Business Analysts, and other teams within DTOne to deliver a high-performing system that addresses daily operational challenges and supports organizational scalability.

Key responsibilities

• Design and build a highly reliable data lake operating at scale with a strong emphasis on data quality, integrity, and availability.

• Build complex new data pipelines to continuously expand capabilities with new data sources.

• Develop tools, internal libraries, automated ETL creation, and data exploration frameworks to empower Data Scientists, Business Analysts, and Engineers.

• Migrate Machine Learning and Data Applications from POC/MVP stage to production grade (ensuring high availability, scalability, and security).

• Architect and scale infrastructure for Generative AI, LLM deployment, model fine-tuning, and vector retrieval (RAG).

• Monitor and maintain all data systems, including ETLs, Data Warehouses, and Data Applications.

• Provide actionable insights on Data Governance, industry best practices, and large-scale processing.

• Support cross-functional teams with guidance on data usage, processing, and platform adoption.

Qualifications and Experience

• Expertise in medium- to large-scale data processing systems, preferably based on open-source systems or AWS services.

• Strong software development skills in one or more languages such as Python, Java, or Scala.

• Advanced knowledge of SQL and SQL Database administration.

• Hands-on experience with AWS infrastructure and Docker frameworks.

• Experience with distributed processing systems such as Spark, Presto, or Hadoop.

• Solid background in Data Warehousing and Data Modeling.

• Experience with MLOps frameworks, LLM orchestration tools (e.g., LangChain, LlamaIndex), and vector databases (e.g., Pinecone, Milvus, Qdrant).

The ideal candidate is someone who:

• Has a bias towards action and shipping, starting small and growing iteratively.

• Is obsessed with data compliance, security, quality, and integrity.

• Is passionate about learning new technologies, languages, infrastructure, and data analysis to drive meaningful impact.

• Stays creative and generates fresh ideas leveraging technical expertise.

• Enjoys sharing knowledge through coaching, events, and collaboration.

Sound like you? Apply now!