As a Senior Data Engineer at 3Pillar, you'll leverage advanced data technologies to enhance data analytics projects, supporting analytics that give clients a competitive edge. Your role will include designing data systems and guiding a team of engineers.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
Minimum Qualifications
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
- Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
- Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
- Proficiencient in data pipeline and workflow management tools e.g. Airflow
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
- Experience with the AWS/Azure/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
- OR
- Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
- Very good exposure of working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Ability to guide other data engineers.
Top Skills
Python
SQL
Similar Jobs
As a Senior Data Engineer at Atlassian, you will work with a world-class data engineering team, focusing on defining metrics, ensuring data quality, and optimizing data workflows. You will partner with product teams and data consumers to drive strategic decision-making by collecting and analyzing data, thus enhancing product experiences and business performance.
As a Data Platform Engineer, you'll own and drive data management initiatives, focusing on data ingestion, processing, and storage. You'll design scalable systems, ensure fault tolerance, work on ETL frameworks, and collaborate with multiple teams to deliver features.
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
