As a Data Engineer
You design, build, and optimize large-scale data pipelines and platforms across cloud environments. You manage data integration from multiple business systems, ensuring high data quality, performance, and governance. You collaborate with cross-functional teams to deliver trusted, scalable, and secure data solutions that enable analytics, reporting, and decision-making.
Meet the job
● Data Engineering : Design, build, and optimize scalable ETL/ELT pipelines using Azure Data Factory, Databricks, PySpark, and SQL;
● Cloud Data Platforms : Manage and integrate data across Azure (Synapse, Data Lake, Event Hub, Key Vault) and GCP (BigQuery, Cloud Storage);
● API Integration : Develop workflows for data ingestion and processing via REST APIs and web services, including integrations with BambooHR, Salesforce, and Oracle NetSuite;
● Data Modeling & Warehousing : Build and maintain data models, warehouses, and lakehouse structures to support analytics and reporting needs;
● Performance Optimization : Optimize Spark jobs, SQL queries, and pipeline execution for scalability, performance, and cost-efficiency;
● Governance & Security : Ensure data privacy, security, and compliance while maintaining data lineage and cataloging practices;
● Collaboration : Partner with business stakeholders, analysts, and PMO teams to deliver reliable data for reporting and operations;
● Documentation : Create and maintain technical documentation for data processes, integrations, and pipeline workflows;
How about you
● Education : Bachelor’s/Master’s degree in Computer Science, Engineering, Analytics, Mathematics, Statistics, IT, or equivalent;
● Experience : 5+ years of experience in Data Engineering and large-scale data migration projects;
● Technical Skills : Proficient in SQL, Python, and PySpark for data processing and transformation;
● Big Data & Cloud : Hands-on expertise with Apache Spark, Databricks, and Azure Data Services (ADF, Synapse, Data Lake, Event Hub, Key Vault);
● GCP Knowledge : Exposure to Google Cloud Platform (BigQuery, Cloud Storage) and multi-cloud data workflows;
● Integration Tools : Exposure to tools such as Workato for API-based data ingestion and automation;
● Best Practices : Strong understanding of ETL/ELT development best practices and performance optimization;
● Added Advantage : Certifications in Azure or GCP cloud platforms;
● Domain Knowledge : Preferable to have knowledge of Oracle NetSuite, BambooHR, Salesforce data ingestion, and PMO data operations;
● Soft Skills : Strong problem-solving skills, effective communication, and ability to work both independently and in cross-functional teams while mentoring junior engineers.