We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Software • Consulting
Lead modernization of a large-scale AWS data platform: design, build, and optimize scalable ETL/ELT pipelines, migrate Airflow/EMR to AWS-native services (Glue, MWAA), implement data lake/warehouse solutions, enforce data governance/lineage/metadata, build data quality and monitoring frameworks, automate deployments with IaC, and support BI (QuickSight) and Power BI migration, UAT, and production support.
Top Skills:
Amazon AthenaAmazon EmrAmazon EventbridgeAmazon MwaaAmazon QuicksightAmazon RedshiftAmazon S3Apache AirflowSparkAws GlueAws Glue Data CatalogAws IamAws LambdaAws Step FunctionsCi/CdCloudFormationGitLake FormationPower BIPysparkPythonSQLTerraform
Information Technology • Database • Consulting
Design, build, and maintain scalable cloud-native data pipelines and dimensional data models using DBT, SQL, and AWS services. Implement infrastructure-as-code with AWS CDK, automate CI/CD, ensure data quality and governance, optimize performance, and collaborate with cross-functional teams and offshore partners to deliver analytics-ready data assets.
Top Skills:
Amazon RedshiftAws CdkAws CodecommitAws CodepipelineAws GlueAws LambdaAws MwaaAws Step FunctionsCi/CdDbtJinjaPysparkPythonSQL
Fintech • Financial Services
Design and implement scalable, fault-tolerant big-data and cloud-based data applications to support low-latency fraud analytics. Partner with architects, data scientists and product teams to build pipelines, integrate AI services, ensure data management standards, and drive production deployments and automation in a scaled Agile environment.
Top Skills:
APIsAWSBedrockCassandraEmrGlueGraph DatabasesHadoopHiveKafkaMySQLPythonRedshiftS3SagemakerScalaSparkSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
