Develop and optimize data engineering pipelines using Python, Databricks, Spark, PySpark, SQL, and AWS services. Build ETL/ELT workflows, transform and integrate data, troubleshoot pipeline issues, and apply data warehousing concepts. The role also involves working with Delta Lake, pipeline orchestration, Git, and CI/CD practices while collaborating effectively and solving complex data problems.
This is a remote position.
Job Title: Databricks / AWS / Python Developer
Experience: 5–6 Years
Job Description:
- Strong hands-on experience in Python programming and data engineering.
- Good exposure to Databricks, including notebooks, Spark, and data processing.
- Experience with AWS services such as S3, Glue, Lambda, and Redshift.
- Knowledge of PySpark, SQL, ETL/ELT pipelines, and data transformation.
- Experience in developing, optimizing, and troubleshooting data pipelines.
- Understanding of data warehousing concepts and data integration.
- Good analytical, problem-solving, and communication skills.
Preferred Skills:
- Experience with Databricks on AWS.
- Knowledge of Delta Lake and data pipeline orchestration.
Exposure to Git and CI/CD practices.
Similar Jobs
Database
Build and maintain Supabase’s public Python SDK across database, authentication, storage, realtime, and edge functions. Develop natural sync and async APIs, manage typing, packaging, testing, release automation, documentation, and issue triage. Collaborate with cross-functional teams and open-source contributors, support multiple Python environments, maintain WebSocket functionality, and design migration paths for API changes. Work autonomously in a remote, asynchronous environment while making the SDK accessible to developers and AI coding agents.
Top Skills:
AsyncioCi/CdJwtOauthPostgresPyproject.TomlPythonPython TypingTypeddictWebsocketsWheels
Information Technology • Professional Services • Software • Consulting
Develop Python applications and backend services powered by Agentic AI, autonomous agents, multi-agent workflows, and LLMs. Responsibilities include building tool- and function-calling workflows, REST APIs, RAG solutions, external integrations, and production-ready AI applications. The role also supports testing, deployment, optimization, and collaboration with engineering teams. Preferred experience includes AI frameworks, cloud platforms, containerization, vector databases, prompt engineering, and LLM evaluation.
Top Skills:
Agentic AiAnthropic ClaudeAutogenAutonomous AgentsAws BedrockAzure OpenaiCrewaiDockerEmbeddingsFastapiFlaskGenerative AiGoogle Vertex AiKubernetesLangchainLanggraphLarge Language Models (Llms)Multi-Agent SystemsOpenaiPythonRagRest ApisSemantic SearchVector Databases
Artificial Intelligence • Food • Software
Build, operate, and scale enterprise web applications using Python and React.js. Develop REST and GraphQL APIs, asynchronous processing, responsive interfaces, database queries, automated tests, and CI/CD workflows. Own features end to end, improve architecture and observability, modernize legacy systems, resolve outages, reduce technical debt, and mentor engineers. Collaborate with Product and Design in a remote, pod-based organization while leveraging AI coding agents.
Top Skills:
AWSCi/CdClaude CodeCodexDatadogDockerGithub ActionsGraphQLJavaScriptMySQLNew RelicPostgresPythonReactRestSentrySidekiqSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
