We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer will lead the data engineering team, architecting solutions and driving complex data projects to enhance operational data quality and support business decisions.
Top Skills:
AirflowAthenaAWSEmrFlinkHiveKafkaRedshiftSparkSQL
Fitness • Healthtech • Retail • Pharmaceutical
Design, build, and maintain ETL pipelines and data infrastructure to support analytics and reporting. Write and schedule workflows (Airflow DAGs), manage third-party data ingestion, implement data validation, optimize performance, and collaborate on data models, governance, and ML model deployments.
Top Skills:
Amazon RedshiftApache AirflowAWSAzureETLGCPLuigiPostgresPythonSQL
Fintech • Software • Financial Services • Cryptocurrency
Design and build distributed batch and real-time data pipelines, ingestion frameworks, data models, feature stores, and data quality monitoring to enable scalable ML and analytics. Integrate multiple data sources, optimize performance and costs, and ensure security, governance, and seamless integration with ML engineering.
Top Skills:
AirflowSparkAws GlueBigQueryDbtEmrHadoopKafkaKinesisLambdaPythonRedshiftS3SnowflakeSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
