Develop and maintain data pipelines using AWS technologies. Collaborate with teams to design data solutions and optimize existing systems. Create data models and perform end-user querying.
Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.
Mactores is seeking an AWS Data Engineer (Senior) to join our team. The ideal candidate will have extensive experience in PySpark and SQL, and have worked with data pipelines using Amazon EMR or Amazon Glue. The candidate must also have experience in data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, Presto, and orchestration experience using Airflow.
What you will do?
- Develop and maintain data pipelines using Amazon EMR or Amazon Glue.
- Create data models and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
- Build and maintain the orchestration of data pipelines using Airflow.
- Collaborate with other teams to understand their data needs and help design solutions.
- Troubleshoot and optimize data pipelines and data models.
- Write and maintain PySpark and SQL scripts to extract, transform, and load data.
- Document and communicate technical solutions to both technical and non-technical audiences.
- Stay up-to-date with new AWS data technologies and evaluate their impact on our existing systems.
What are we looking for?
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience working with PySpark and SQL.
- 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue.
- 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
- 1+ years of experience building and maintaining the orchestration of data pipelines using Airflow.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
- Ability to work independently and within a team environment.
You are preferred if you have
- AWS Data Analytics Specialty Certification
- Experience with Agile development methodology
Life at Mactores
We care about creating a culture that makes a real difference in the lives of every Mactorian. Our 10 Core Leadership Principles that honor Decision-making, Leadership, Collaboration, and Curiosity drive how we work.
1. Be one step ahead
2. Deliver the best
3. Be bold
4. Pay attention to the detail
5. Enjoy the challenge
6. Be curious and take action
7. Take leadership
8. Own it
9. Deliver value
10. Be collaborative
We would like you to read more details about the work culture on https://mactores.com/careers
The Path to Joining the Mactores Team
At Mactores, our recruitment process is structured around three distinct stages:
Pre-Employment Assessment:
You will be invited to participate in a series of pre-employment evaluations to assess your technical proficiency and suitability for the role.
Managerial Interview: The hiring manager will engage with you in multiple discussions, lasting anywhere from 30 minutes to an hour, to assess your technical skills, hands-on experience, leadership potential, and communication abilities.
HR Discussion: During this 30-minute session, you'll have the opportunity to discuss the offer and next steps with a member of the HR team.
At Mactores, we are committed to providing equal opportunities in all of our employment practices, and we do not discriminate based on race, religion, gender, national origin, age, disability, marital status, military status, genetic information, or any other category protected by federal, state, and local laws. This policy extends to all aspects of the employment relationship, including recruitment, compensation, promotions, transfers, disciplinary action, layoff, training, and social and recreational programs. All employment decisions will be made in compliance with these principles.
Note: Please answer as many questions as possible with this application to accelerate the hiring process.
Mactores Mumbai, Maharashtra, IND Office
316, Neelkanth Corporate Park, Vidyavihar West, Mumbai, India, 400086
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.
Top Skills:
Aws EksAws RdsAws S3DockerDtcc RttmDtcc Settlement WebEtl/Elt FrameworksFixFxmlIbm MqIso 15022KafkaKubernetesRest ApisSQL ServerUnified Trade Record (Utr)
Cloud • Information Technology • Productivity • Software • Automation
Lead consultative pre-sales technical engagements, design integration and AI solution strategies across Boomi's platform, deliver demos and presentations, support RFIs/RFPs and POCs, collaborate with account teams and partners, and act as a trusted advisor to demonstrate business value and ROI.
Top Skills:
Agent-Based AutomationAIApi ManagementAPIsBoomiBoomi AgentstudioData Pipeline Orchestration ToolsFederated Api ManagementGroovyIntegration PatternsIpaasJavaScriptLlmManaged File Transfer (Mft)Messaging QueuesMiddlewarePrompt EngineeringPythonRagRiveryThruVector Search
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
