Design and develop scalable data-driven solutions and pipelines using Python and SQL. Leverage Azure data services to build secure, high-performance architectures, ensuring data integrity, governance, and overall success of data projects.
As a Data Engineer, you will play a crucial role in designing and developing data-driven solutions for our clients. Your expertise in data exploration, Python, and SQL will be utilized to create efficient and scalable data pipelines. With a focus on Azure, you will leverage its data products and services to build robust and secure data architectures. Your role is key in ensuring data integrity, performance, and governance, while also contributing to the overall success of our data-centric projects.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical evolution of Atlassian’s data engineering capabilities by architecting scalable batch and streaming data solutions. Direct complex engineering efforts, improve data quality and productivity, establish technical direction, and coordinate implementation across teams. Mentor and coach data engineers while partnering cross-functionally to support data-driven business decisions and long-term platform scalability.
Top Skills:
Apache AirflowApache FlinkApache HiveApache KafkaSparkAws AthenaAws EmrAws RedshiftDatabricksKappa ArchitectureLambda ArchitectureMaster Data ManagementMicroservicesSQL
Information Technology • Database • Consulting
Designs and implements data pipelines, optimizes data processing and storage, ensures data accuracy and performance, provides technical support, and collaborates with data scientists, analysts, and stakeholders to resolve data issues and meet data requirements.
Healthtech • Pharmaceutical • Manufacturing
Designs, develops, and maintains scalable ETL and data integration pipelines using Snowflake, AWS Glue, Fivetran, and Snowpipes. Responsibilities include data transformation, quality validation, performance tuning, monitoring, troubleshooting, documentation, and data lineage. The role collaborates with architects, modelers, and source-system owners to integrate databases, APIs, files, and other data sources. It requires advanced SQL, scripting, relational and NoSQL database knowledge, and substantial ETL engineering experience.
Top Skills:
APIsAws GlueAws S3Azure Data FactoryChange Data CaptureCopy CommandDatastageFivetranGoogle DataflowHadoopHvrInformatica IicsInformatica PowercenterNoSQLOraclePerlPostgresPythonSftpShell ScriptingSnowflakeSnowpipeSparkSQLSQL Server
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
