The Senior Data Engineer is responsible for developing and maintaining ETL processes, utilizing SQL and dbt for data transformation, and managing data workflows using Apache Airflow. This role requires collaboration with various teams to integrate and analyze data, ensuring high-quality data pipelines and effective problem-solving with large datasets.
Senior Data Specialist
Primary Skills
- ETL Fundamentals, SQL, SQL (Basic + Advanced), Alation, Talend, Python, Snowflake, Data Warehousing, DBT, Airflow, IICS, Modern Data Platform Fundamentals, Data Modelling Fundamentals, Unix, PLSQL, T-SQL, Stored Procedures, Salesforce Marketing Cloud (Marketing)
Job requirements
- About Brillio:
- Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.
- Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
- Work Location: Hyderabad
- Job Description:
- Experience: 7-9 years
- Skills: DBT, ETL, Snowflake, Airflow, Python, GIT
- Tools - AWS, DBT, Airflow, Snowflake
- Source Systems - Salesforce Sales Cloud, Google Analytics, Data Cloud
- Metrics - Pipeline, CSP, Product Usage and Ops, Web
- Location - Hyderabad
- Hybrid - 3 days in the office
- Proficiency in SQL for data manipulation, transformation, and processing.
- Expertise in dbt to develop modular, scalable, and well-documented transformation logic.
- Hands-on experience with Apache Airflow for workflow scheduling and monitoring.
- Strong knowledge of cloud-based data platforms, including S3, Snowflake, and/or Databricks.
- Familiarity with email data and programs including send, open, click, bounce, unsubscribe etc
- Experience integrating and analyzing data from Email Service Providers such as Salesforce Marketing Cloud (SMC) is a plus.
- Strong problem-solving skills with the ability to work with large datasets and debug data pipeline issues.
- Excellent communication skills to collaborate effectively with marketing, analytics, and engineering teams.
- Working knowledge of Data Cloud is a plus.
- Preferred Qualifications
- Exposure to Python for data processing and automation.
- Understanding of marketing attribution models and multi-touch attribution for email campaigns.
Top Skills
Airflow
Alation
Data Modelling Fundamentals
Data Warehousing
Dbt
ETL
Iics
Modern Data Platform Fundamentals
Plsql
Python
Salesforce Marketing Cloud
Snowflake
SQL
Stored Procedures
T-Sql
Talend
Unix
Similar Jobs
.jpg)
Artificial Intelligence • Computer Vision • Machine Learning • Payments • Real Estate • PropTech
As a Senior Data Engineer, you will design and develop data pipelines and architecture for large-scale projects, collaborate with teams to define data needs, and solve complex integration challenges while ensuring data quality and governance.
Top Skills:
AirflowAutomicCi/CdDbtEltETLMs Sql ServerMySQLPostgresPysparkPythonSnowflakeSparkSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer at Atlassian, you'll build and manage data pipelines and services, work with stakeholders to improve data ingestion into the data lake, and create efficient micro-services. Your technical expertise will help enhance a multi-petabyte data lake using a variety of tools including Spark and AWS services.
Top Skills:
AirflowAWSEmrHiveJavaKinesisPrestoPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Principal Data Platform Engineer, you will build a world-class data platform solution, collaborating with analysts, engineers, and data scientists to identify gaps and implement innovative data tool capabilities while ensuring data quality and seamless experiences for users.
Top Skills:
Amazon Web ServicesBig DataContinuous DeliveryContinuous IntegrationDbtFlaskGitJavaKotlinMicro ServicesPythonRestful ApisS3SparkSQLTest Automation
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
