Designs and implements data pipelines, optimizes data processing and storage, ensures data accuracy and performance, provides technical support, and collaborates with data scientists, analysts, and stakeholders to resolve data issues and meet data requirements.
Data Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are required.
ResponsibilitiesDesign and implement data pipelines, Optimize data processing and storage, Ensure data solutions meet performance standards, Provide technical support, Collaborate with stakeholders.
QualificationsBachelor's/Master's in Engineering 2-5 years
Similar Jobs
Database
Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.
Top Skills:
AWSAws Cost And Usage ReportsAws Cost ExplorerAws LambdaBashBigQueryCloudzeroDbtGCPGcp Billing ReportsHexLinearNotionPulumiPythonSQLTerraformVantage
Information Technology • Consulting
Designs and maintains scalable data pipelines and ETL/ELT workflows using Python, SQL, and Azure Databricks. Manages large structured and semi-structured datasets, data models, monitoring, quality controls, troubleshooting, and production support. Integrates LLM and Generative AI capabilities, including APIs, embeddings, prompt engineering, and RAG workflows, into data solutions. Collaborates with engineering, analytics, and business teams while following security, CI/CD, documentation, and maintainability best practices.
Top Skills:
Azure Data FactoryAzure Data Lake Storage (Adls)Azure DatabricksAzure DevopsAzure Openai ServiceAzure SqlAzure Synapse AnalyticsCi/CdEmbeddingsEtl/EltGenerative AiGitLarge Language Models (Llms)Llm ApisPrompt EngineeringPythonRest ApisRetrieval-Augmented Generation (Rag)SQLVector DatabasesVector Search
Information Technology • Software • Business Intelligence
Design, build, and optimize GCP data ecosystems, including pipelines, data lakes, warehouses, storage architectures, and processing infrastructure. Gather requirements, model data, troubleshoot complex issues, tune performance, monitor systems, and support new functionality. Collaborate directly with clients and cross-functional teams, while mentoring junior data engineers and leading technical improvement discussions.
Top Skills:
AlteryxApache AirflowSparkBigQueryConfluenceDatabricksDataformDbtEltETLGitGoogle Cloud FunctionsGoogle Cloud Platform (Gcp)Google Cloud StorageJIRALookerAzureNoSQLPower BIPythonSQLTableauTalend
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
