Develop and maintain scalable Python-based data pipelines, ETL processes, workflow automations, and dataset integrations. Ensure data quality, validation, performance, and integrity while deploying and monitoring production workflows. Collaborate with data engineers, analysts, stakeholders, and machine learning teams to provide reliable, production-ready data solutions. Work with databases, cloud data services, orchestration tools, APIs, and CI/CD practices.
Job Summary:
Key Responsibilities:
Technical Skills Required:
Preferred Qualifications:
We are looking for a Python Developer with strong data engineering and data handling skills. The ideal candidate will work on building scalable data pipelines, automating workflows, integrating datasets, and supporting analytics and ML teams with clean, reliable data solutions.
- Develop, optimize, and maintain data pipelines using Python.
- Work with large datasets and ensure efficient extraction, transformation, and loading (ETL).
- Integrate data from various internal and external sources.
- Build reusable Python modules and automation scripts.
- Work closely with data engineers, analysts, and stakeholders to understand requirements.
- Optimize performance of data processes and troubleshoot issues.
- Ensure data quality, validation, and integrity across systems.
- Deploy and monitor data workflows in production environments.
- Strong hands-on experience in Python (Pandas, NumPy, PySpark preferred).
- Experience with ETL development and building data pipelines.
- Good understanding of SQL, complex queries, and stored procedures.
- Experience with databases (PostgreSQL, MySQL, MongoDB, or similar).
- Exposure to big data frameworks (Spark/Hadoop) is a strong advantage.
- Experience with cloud platforms (AWS/Azure/GCP) for data services.
- Familiarity with API integrations, automation, and scheduling tools (Airflow, Cron).
- Knowledge of version control (Git) and CI/CD practices.
- Advanced experience with Python libraries used in data workflows (Pandas, NumPy, PySpark, FastAPI/Flask for data services).
- Hands-on experience with data warehousing concepts and building scalable data models.
- Practical understanding of ML model pipelines and supporting data science teams with clean, production-ready datasets.
- Experience working with workflow orchestration tools (Airflow, Prefect, Luigi).
- Familiarity with containerization and deployment (Docker/Kubernetes) for data applications.
- Strong understanding of cloud-based data services (AWS Glue, Redshift, Azure Data Factory, BigQuery).
- Bachelor’s degree in Computer Science, Engineering, or a related technical field.
Similar Jobs
Financial Services
Develop and support full-stack, data-enabled applications using Python and FastAPI back ends, React front ends, Databricks data workflows, SQLite persistence, and SharePoint integrations. Responsibilities include API and UI development, data transformation, testing, documentation, CI/CD, deployment support, observability, troubleshooting, stakeholder collaboration, and secure, resilient solution delivery.
Top Skills:
SparkCi/CdDatabricksFastapiGitJavaScriptOpenapiPythonReactSharepointSQLSqliteSwaggerTypescript
Financial Services
Develop and support full-stack, data-enabled applications using Python, FastAPI, React.js, Databricks, SQLite, and SharePoint. Build REST APIs, front-end components, data workflows, integrations, and persistence layers while contributing to testing, documentation, CI/CD, deployments, observability, troubleshooting, and secure coding. Collaborate with stakeholders to clarify requirements, estimate work, deliver iteratively, and maintain operational runbooks.
Top Skills:
SparkCi/CdDatabricksFastapiGitJavaScriptOpenapiPythonReactRest ApisSharepointSQLSqliteSwaggerTypescript
Financial Services
Develop and support full-stack, data-enabled applications using Python, FastAPI, React.js, Databricks, SQLite, and SharePoint. Responsibilities include building REST APIs and user interfaces, creating production data workflows, implementing persistence, writing tests, supporting deployments and observability, troubleshooting operational issues, collaborating with stakeholders, and maintaining technical documentation. The role requires strong software engineering fundamentals, secure coding practices, communication, and ownership of iterative delivery.
Top Skills:
SparkCi/CdDatabricksFastapiGitJavaScriptOpenapiPythonReactSharepointSQLSqliteSwaggerTypescript
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
