Design and develop scalable data-driven solutions and pipelines using Python and SQL. Leverage Azure data services to build secure, high-performance architectures, ensuring data integrity, governance, and overall success of data projects.
As a Data Engineer, you will play a crucial role in designing and developing data-driven solutions for our clients. Your expertise in data exploration, Python, and SQL will be utilized to create efficient and scalable data pipelines. With a focus on Azure, you will leverage its data products and services to build robust and secure data architectures. Your role is key in ensuring data integrity, performance, and governance, while also contributing to the overall success of our data-centric projects.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.
Top Skills:
AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The job description does not include specific responsibilities or qualifications because the position details were replaced with a placeholder. Based on the title, this is a principal-level role focused on data platform engineering.
Agency • Professional Services • Consulting
Designs, builds, tests, and optimizes scalable ETL and ELT pipelines in GCP. Develops data warehousing and transformation solutions using BigQuery, Cloud Dataflow, Cloud Composer, Snowflake, Oracle, and other databases. Writes Java, Python, and advanced SQL; establishes reconciliation, schema, regression, and data-driven testing. Integrates pipelines with CI/CD tools and collaborates in Agile teams using Jira and Confluence.
Top Skills:
Apache AirflowApache Beam SdkBdd CucumberBigQueryCloud ComposerCloud Data FusionCloud DataflowCloud SpannerCloud SqlCloud StorageConfluenceGCPGcp Cloud BuildGitGitHp AlmInformatica PowercenterJavaJdbcJenkinsJIRAJunitMavenMySQLOraclePandasPl/SqlPostgresPytestPythonSnowflakeSQLTalendTeradataTestng
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
