The Senior Data Engineer will design, develop, and implement data solutions, build and optimize data pipelines, and collaborate with teams to enhance data architecture and ensure data quality and integrity.
ProArch is seeking a talented and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and implementing data solutions that tackle complex business problems. You will play a pivotal role in building data pipelines, optimizing data workflows, and collaborating with cross-functional teams to enhance our data architecture. If you are passionate about data engineering and looking for an opportunity to make a significant impact, we would love to hear from you!
Key Responsibilities:
- Design, develop, and maintain robust data pipelines to support data processing and analytics needs.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and build solutions that meet business objectives.
- Optimize and enhance data workflows for performance and scalability.
- Implement data quality checks and validation processes to ensure data accuracy and integrity.
- Work with cloud platforms (AWS, Azure, Google Cloud) to leverage cloud-based data storage and analytics services.
- Assist in the overall data architecture strategy and best practices for the organization.
- 7+ years of experience in data engineering or related fields.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL database systems and NoSQL technologies.
- Hands-on experience with ETL tools and data pipeline orchestration (e.g., Apache Airflow, AWS Glue).
- Familiarity with data warehousing concepts and tools (e.g., Snowflake, Amazon Redshift).
- Experience with cloud infrastructure (e.g., AWS, Microsoft Azure, Google Cloud Platform).
- Ability to work collaboratively in a team environment and communicate effectively with technical and non-technical stakeholders.
- Strong problem-solving skills and attention to detail.
NA
Top Skills
Java
Python
Scala
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
SailPoint seeks a Senior Data Engineer to design and implement robust data ingestion and processing systems. Responsibilities include developing scalable data pipelines, integrating diverse data sources, leveraging AWS services, and using tools like Apache Airflow for orchestration. Candidates should have extensive experience in data engineering and relevant technologies.
Top Skills:
Apache AirflowAWSDockerFlinkKubernetesSpark
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Data Engineer at SailPoint will design and implement ELT processes for data ingestion and processing systems. Responsibilities include developing scalable data pipelines, collaborating with cross-functional teams, and utilizing AWS services to ensure efficient data solutions. The role requires strong adaptability and problem-solving skills in a dynamic environment.
Top Skills:
AWSDockerFlinkKubernetesSpark
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Senior Data Engineer will design, build, and measure complex ELT jobs for processing various data sources. They will work collaboratively on projects involving batch pipelines, data modeling, and data mart solutions to implement efficient data collection and processing pipelines that meet business needs.
Top Skills:
Data Modeling
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.