Lingaro Logo

Lingaro

Data Engineering Architect

Posted 24 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Expert/Leader
Remote
Hiring Remotely in India
Expert/Leader
Design and oversee data architecture, ensure compliance, create data processing frameworks, and lead data engineering teams. Collaborate with stakeholders to meet business needs.Data governance and performance optimization included.
The summary above was generated by AI
1

Tasks:

  • Acting as a Senior Consultant/Solution Advisor:

  • Technology partner: Advise on designing data architectures in Microsoft Azure.
  • Empowering customer to spot and leverage business opportunities by unlocking the power of data. 
  • Providing technical and problem-solving expertise for client representatives and Lingaro project teams. 
  • Data Integration: Lead data integration efforts, including ETL processes, to ensure seamless data flow. 
  • Cloud Services Utilization: Leverage Azure, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions. 
  • Advise on security measures and compliance standards in cloud environments. 
  • Continuously monitor and optimize data solutions for cost-efficiency. 
  • Data Governance: Advise data governance and quality standards. 
  • Collaboration: Work with cross-functional teams to understand requirements and provide data solutions. 
  • Mentoring junior team members in cloud data architecture best practices. 
  •  
  • Daily tasks including:
  • implementing data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools.
  • developing scalable and re-usable, self-service frameworks for data ingestion and processing.
  • designing, building, and managing SQL server databases in the Azure cloud.
  • performing data modelling and integrating data from various systems
  • reviewing and implementing best practices for data manipulation
  • creating and supporting Azure Data Factory pipelines.
  • Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data.

What we are looking for:

  • 11+ years of professional experience in the Data & Analytics area, 
  • 5+ years of experience in the Senior Consultant role with a strong focus on Azure data solutions
  • Advanced knowledge and understanding of architecture, application design, systems engineering, and integration. 
  • Very good knowledge of cloud data services, data warehousing, big data technologies, and data lakes. Especially Azure, DataBricks
  • Expertise in data modeling, data integration, and ETL processes. 
  • Proven experience in using of Microsoft ETL tools (Azure Databricks, Azure Data Factory, Data Lake and SSIS)
  •  Databricks Unity Catalog, Asset Bundles, Data Factory, Microsoft Fabric. Logic App, Function App.
  • Programming skills for data analysis (especially PySpark, SparkSQL, Python, SQL)
  • Familiarity with data governance, data security, and compliance standards. 
  • Familiarity with agile methodologies and the ability to apply DevOps and DataOps principles to data pipelines. 
  • Ability to use ARM templates
  • Experience in working with JSON
  • Good understanding of business processes and the ability to drive automation through effective management. 
  • This role involves designing the project architecture. Setup, monitoring Internal Developer Platform. UC migration. Building Databricks Asset Bundles. PR reviews. Data Model / Semantic Layer setup.  Model QA automation. 

What we offer:

  • Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
  • “Office as an option” model. You can choose to work remotely or in the office, depending on your location.  
  • Flexibility regarding working hours and your preferred form of contract.  
  • Comprehensive online onboarding program with a “Buddy” from day 1.   
  • Cooperation with top-tier engineers and experts.  
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly. 
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
  • Internal Gallup Certified Strengths Coach to support your growth.
  • Grow as we grow as a company. 76% of our managers are internal promotions.  
  • A diverse, inclusive, and values-driven community.   
  • Autonomy to choose the way you work. We trust your ideas.  
  • Create our community together. Refer your friends to receive bonuses.  
  • Activities to support your well-being and health.
  • Plenty of opportunities to donate to charities and support the environment.  
  • Modern office equipment. Purchased for you or available to borrow, depending on your location

Top Skills

Azure Data Factory
Databricks
Logic App
Pyspark
Python
SQL

Similar Jobs

16 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Senior Project Manager facilitates agile ceremonies, aligns stakeholders, tracks delivery metrics, leads multiple agile teams, and mentors Scrum leads.
Top Skills: Agile MethodologiesAzure DevopsCi/Cd PipelinesDevops Practices
16 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The role involves managing software development test lifecycles, developing test automation code, enhancing testing tools, and collaborating with teams to implement effective testing processes.
Top Skills: AgileBehavior Driven Development (Bdd)Ci/CdTest Automation
22 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Security • Cybersecurity
As an R&D Escalations Engineer, resolve customer issues escalated to R&D by troubleshooting, diagnosing, and implementing solutions while collaborating with support and development teams.
Top Skills: HibernateJavaKotlinLinuxMongoDBSpringSQL

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account