Datavail Logo

Datavail

AWS Glue Consultant

Posted 3 Days Ago
Be an Early Applicant
Hybrid
Mumbai, Maharashtra, IND
Senior level
Hybrid
Mumbai, Maharashtra, IND
Senior level
The Technical Specialist designs and maintains scalable ETL/ELT pipelines, optimizes data lakes and warehouses, and ensures data accuracy and governance while collaborating with cross-functional teams.
The summary above was generated by AI

Title: Technical Specialist

Location: Mumbai

Exp Level: 8+

Education: Any Degree

 

Key Skills: 

•    Strong expertise with AWS services such as: 
•    S3, Glue, Lambda, Athena, Redshift, EMR, DynamoDB, IAM.
•    Proficiency in Python, SQL, and PySpark

Required Skills:

  • Total 8+ years of experience 

  • 3+ years of experience as a Data Engineer (or similar role).

Data Architecture & Engineering

  • Design, develop, and maintain scalable ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, EMR, etc.).
  • Build and optimize data lakes and data warehouses using S3, Redshift, Lake Formation.

  • Develop, manage, and optimize SQL/NoSQL data models.

  • Implement real-time and batch data processing solutions using Kinesis, Kafka, or similar streaming platforms.

Cloud Engineering

  • Ensure data pipelines are reliable, scalable, secure, and cost optimized.

  • Implement monitoring and logging using CloudWatch, SNS, and related services.

Data Quality & Governance

  • Ensure data accuracy, consistency, and completeness across all systems.

  • Implement data governance, lineage, and cataloging using Glue Data Catalog or similar tools.

  • Work closely with data analysts, scientists, and business stakeholders to deliver trusted datasets.

Collaboration

  • Work with cross functional teams to gather data requirements.

  • Support BI/reporting teams with optimized datasets.

  • Participate in code reviews and contribute to engineering best practices.

 

About UsDatavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.

Top Skills

Aws Athena
Aws Dynamodb
Aws Emr
Aws Glue
Aws Iam
Aws Lambda
Aws Redshift
Aws S3
Pyspark
Python
SQL

Similar Jobs

22 Hours Ago
In-Office
Mumbai, Maharashtra, IND
Mid level
Mid level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
The Support Engineer will troubleshoot and resolve customer issues, provide technical support for 5G/4G solutions, and participate in security reviews.
Top Skills: 4G5GCaDssMsrbsRan
22 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Assistant Manager - Operations supports financial reporting, ensuring compliance with US GAAP, conducting variance analysis, and collaborating across teams for accurate periodic reporting.
Top Skills: HfmPeoplesoftSmartviewUs GaapWorkiva Wdesk
22 Hours Ago
Hybrid
Mid level
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The role involves financial planning and analysis support, including revenue and expense management, business performance analysis, and reporting for various stakeholders. Requires close collaboration with teams for timely and accurate financial submissions.
Top Skills: ExcelMetlife SystemsPowerPoint

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account