As a Data Engineer, you will contribute to data analytics projects, utilizing advanced SQL and Python, along with various data engineering tools, to shape decision-making processes for clients.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries. If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering!
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational and non-relational databases
- Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
- Strong exposure to write ETL
- Experience in Data collection from multiple sources and integrating based on business needs
- Core Python, PySpark, Hadoop, MariaDB, SQL - good hands-on for query preparation, Automation skillset, JavaScript & JQuery, Banking/Regulatory reporting domain knowledge would be advantage
- Familiarity with the AWS/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda,, GLUE ETL, Athena, RDS, Redshift, EC2
- Proficiency in the English language.
Top Skills
Athena
AWS
Ec2
ETL
GCP
Glue Etl
Hadoop
JavaScript
Lambda
Mariadb
Numpy
Pandas
Pyspark
Python
Rds
Redshift
S3
SQL
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves designing and maintaining large-scale data pipelines using AWS services, particularly Glue, while collaborating on ETL solutions.
Top Skills:
AthenaAWSAws GlueEc2LambdaPysparkPythonRedshiftS3Spark
Financial Services
As a Data Engineer II, you will design and implement scalable data pipelines and ETL processes, maintain data infrastructure, and collaborate with stakeholders for optimizing data access and performance.
Top Skills:
AWSAws EmrAzureGitlabGCPJenkinsLambdaNoSQLPysparkPythonRedshiftS3SQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
