As a Data Engineer at 3Pillar, you will leverage cutting-edge technologies to improve data analytics, integrating data from multiple sources. Your role involves writing ETL processes, preparing queries, and utilizing advanced SQL and Python skills to support clients' data-driven decisions.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries. If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering!
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational and non-relational databases
- Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
- Strong exposure to write ETL
- Experience in Data collection from multiple sources and integrating based on business needs
- Core Python, PySpark, Hadoop, MariaDB, SQL - good hands-on for query preparation, Automation skillset, JavaScript & JQuery, Banking/Regulatory reporting domain knowledge would be advantage
- Familiarity with the AWS/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda,, GLUE ETL, Athena, RDS, Redshift, EC2
- Proficiency in the English language.
Top Skills
Python
SQL
Similar Jobs
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Be an Early Applicant
The role involves leading data engineering efforts within the Wholesale Credit team, focusing on data modeling, API definition, and data pipeline construction. Responsibilities include collaboration on software development, data analysis for model support, and mentoring junior team members.
The Data Engineer II at Cencora will facilitate the enhancement of business analytics solutions, perform data mining, validate data quality, and assist in automated solutions development. Responsibilities also include collaborating across teams to prepare performance forecasts, conducting data research, and ensuring data integrity across various systems.
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.