As a Senior Data Engineer at 3Pillar, you will leverage advanced technologies to enhance data-driven decision-making for clients. Your expertise will involve developing data analytics solutions, managing data pipelines, and utilizing cloud data warehouses. You will also be responsible for guiding fellow data engineers and collaborating within a dynamic team.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
Minimum Qualifications
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
- Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
- Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
- Proficiencient in data pipeline and workflow management tools e.g. Airflow
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
- Experience with the AWS/Azure/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
- OR
- Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
- Very good exposure of working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Ability to guide other data engineers.
Top Skills
Python
SQL
Similar Jobs
Be an Early Applicant
The AWS Data Engineer will develop and maintain data pipelines, create data models, build orchestration for data pipelines, troubleshoot issues, and write maintenance scripts using PySpark and SQL. They will collaborate with teams to design data solutions and stay current with new AWS technologies.
As a Senior AWS Data Engineer, you will develop and maintain data pipelines, create data models, and orchestrate workflows using tools like Amazon EMR, AWS Glue, Airflow, and SQL. Collaborating to understand data needs, you will optimize existing systems and document solutions for varied audiences while staying updated with new AWS technologies.
As a Junior Data Analyst, you will develop and deploy AI/ML models within a business setting, analyzing complex data to support decision-making and business transformation. You will collaborate articulately with team members and stakeholders, ensuring precise data interpretation and model accuracy.
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
