Develop and maintain scalable Python data pipelines, ETL processes, workflow automation, and dataset integrations. Ensure data quality, validation, performance, and production reliability while supporting analytics and machine learning teams. Work with databases, cloud data services, APIs, orchestration tools, and deployment platforms to deliver clean, production-ready data solutions.
Job Summary:
Key Responsibilities:
Technical Skills Required:
Preferred Qualifications:
We are looking for a Python Developer with strong data engineering and data handling skills. The ideal candidate will work on building scalable data pipelines, automating workflows, integrating datasets, and supporting analytics and ML teams with clean, reliable data solutions.
- Develop, optimize, and maintain data pipelines using Python.
- Work with large datasets and ensure efficient extraction, transformation, and loading (ETL).
- Integrate data from various internal and external sources.
- Build reusable Python modules and automation scripts.
- Work closely with data engineers, analysts, and stakeholders to understand requirements.
- Optimize performance of data processes and troubleshoot issues.
- Ensure data quality, validation, and integrity across systems.
- Deploy and monitor data workflows in production environments.
- Strong hands-on experience in Python (Pandas, NumPy, PySpark preferred).
- Experience with ETL development and building data pipelines.
- Good understanding of SQL, complex queries, and stored procedures.
- Experience with databases (PostgreSQL, MySQL, MongoDB, or similar).
- Exposure to big data frameworks (Spark/Hadoop) is a strong advantage.
- Experience with cloud platforms (AWS/Azure/GCP) for data services.
- Familiarity with API integrations, automation, and scheduling tools (Airflow, Cron).
- Knowledge of version control (Git) and CI/CD practices.
- Advanced experience with Python libraries used in data workflows (Pandas, NumPy, PySpark, FastAPI/Flask for data services).
- Hands-on experience with data warehousing concepts and building scalable data models.
- Practical understanding of ML model pipelines and supporting data science teams with clean, production-ready datasets.
- Experience working with workflow orchestration tools (Airflow, Prefect, Luigi).
- Familiarity with containerization and deployment (Docker/Kubernetes) for data applications.
- Strong understanding of cloud-based data services (AWS Glue, Redshift, Azure Data Factory, BigQuery).
- Bachelor’s degree in Computer Science, Engineering, or a related technical field.
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develop scalable backend payment software and cloud-native applications. Responsibilities include designing, coding, testing, deploying, and documenting solutions; participating in prioritization; reviewing code and automation; driving quality and technology standards; collaborating with product stakeholders; mentoring engineers; and improving development processes. The role focuses on Java, Spring Boot, DevOps, Oracle, automation testing, and secure financial transaction systems.
Top Skills:
Automation TestingCloud ComputingDevOpsJavaOracleSpring Boot
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Owns production readiness and lifecycle operations for payment platform services. Responsibilities include improving CI/CD pipelines, DevOps automation, monitoring, capacity planning, incident response, postmortems, resiliency, deployment gating, root-cause analysis, and operational risk management. Partners with development, product, and operations teams to improve reliability and customer experience while mentoring junior engineers.
Top Skills:
ArtifactoryBitbucketChefCi/CdDb2DevOpsGitJavaJenkinsMavenOracleSQLUnix
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Build and maintain petabyte-scale data pipelines, entity-centric data models, and distributed workflows using Databricks and Spark. Partner with data science teams to productionize ML features and artifacts, optimize ETL/ELT processes, and implement testing, monitoring, observability, and incident response. Collaborate with governance and operations teams to ensure secure, compliant data management while supporting scalable merchant identity and trust-profile systems.
Top Skills:
SparkAWSCi/CdDatabricksGCPPythonSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
