Designs, develops, and maintains SQL- and Python-based data pipelines and ETL processes. Performs data cleaning, validation, quality assurance, database optimization, and transformation of raw data into structured datasets for reporting and analytics. Processes data from databases, CSV, and Excel files, automates repetitive tasks, supports production troubleshooting, collaborates with stakeholders, and documents workflows.
About the Role
RequirementsPreferred Skills
ScatterPie Analytics is seeking a Data Engineer to join our growing Data Platforms & Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines, ensuring data quality, and supporting business intelligence initiatives. This role requires strong SQL and Python skills, along with a passion for transforming raw data into meaningful business insights.
- Develop and maintain SQL queries, stored procedures, views, and database objects.
- Design, build, and support ETL processes for data extraction, transformation, and loading.
- Perform data cleaning, validation, and quality assurance activities.
- Analyze raw data and transform it into structured datasets for reporting and analytics.
- Optimize database performance through query tuning and best practices.
- Automate repetitive data processing tasks using Python.
- Process and manage data from multiple sources including databases, CSV, and Excel files.
- Collaborate with business stakeholders and reporting teams to understand data requirements.
- Troubleshoot data-related issues and provide production support.
- Maintain documentation of data workflows and processes.
- Strong SQL knowledge (MySQL, PostgreSQL, SQL Server)
- Python programming
- Pandas and NumPy
- ETL Concepts
- Data Cleaning & Validation
- Excel and CSV Data Processing
- Basic Data Warehousing Concepts
- Git / Version Control
RequirementsPreferred Skills
- Azure / AWS / GCP Fundamentals
- Apache Airflow
- Azure Data Factory (ADF)
- Databricks
- Data Pipeline Automation
- B.E. / B.Tech (IT, Computer Science or related field)
- M.Sc. IT or equivalent qualification
Similar Jobs
Hardware • Software
Designs, develops, and tests scalable data management solutions, including acquisition, integration, and transformation pipelines. Builds data structures and infrastructure across cloud and edge environments using Azure, Databricks, and SAP Data Services. Manages DevOps pipelines, continuous deployment, and containerization. Collaborates with technical leads, analysts, architects, product owners, and business stakeholders to define requirements, deliver high-quality code, and enhance applications.
Top Skills:
AgileAzure Data Factory (Adf)Azure Data Lake Storage (Adls)Ci/CdContainerizationDatabricksDevOpsAzureSap Data ServicesSQLTabular Models
Information Technology • Consulting • Financial Services
Design, develop, optimize, and maintain scalable ETL pipelines using PySpark and AWS Glue. Build data ingestion and transformation workflows, orchestrate processes with AWS Step Functions, and develop Python-based AWS Lambda functions. Support AWS data lake architectures, analytical use cases, monitoring, reliability, and performance optimization. The role also involves SQL and may include Java microservices, REST APIs, and backend integrations.
Top Skills:
AWSAws Data LakesAws GlueAws LambdaAws Step FunctionsETLJavaPysparkPythonRest ApisSQL
Information Technology
Design, develop, and maintain scalable Azure Databricks data solutions, including Lakehouse pipelines, ETL/ELT, streaming, Delta Lake optimization, governance, and CI/CD. Ensure data quality, troubleshoot integrations, optimize workflows, and deliver datasets for BI, machine learning, and GenAI. Lead technical decisions, coordinate cross-functional initiatives, manage team execution, and mentor junior engineers.
Top Skills:
Azure Data FactoryAzure Data Lake StorageAzure Synapse AnalyticsCdcCi/CdDatabricks WorkflowsDelta LakeDelta Live TablesFeature StoreMicrosoft Azure DatabricksMlflowPower BIPysparkRagSQLStreamingTerraformUnity CatalogVector Search
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
