Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
Job Summary:
We're seeking an experienced Data Architect / Senior Data Architect/ Associate Data ArchitectExpertise in data engineering across major data platforms. The ideal candidate will have a
strong background in Python, SQL, ETL, and data modeling, with experience in tools like
Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud
knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and
upskill into Databricks & AI/ML projects.
Key Responsibilities:
● Design, develop, and maintain large-scale data systems
● Develop and implement ETL processes using various tools and technologies
● Collaborate with cross-functional teams to design and implement data models
● Work with big data tools like Hadoop, Spark, PySpark, and Kafka
● Develop scalable and efficient data pipelines
● Troubleshoot data-related issues and optimize data systems
● Transition and upskill into Databricks & AI/ML projects
Requirements:
● Relevent experience in data engineering
● Strong proficiency in Python, SQL, ETL, and data modeling
● Experience with one or more of the following:
○ Teradata
○ Informatica
○ Hadoop
○ Spark
○ PySpark
○ ADF
○ Snowflake
○ Big Data
○ Scala
○ Kafka
● Cloud knowledge (AWS, Azure, or GCP) is a plus
● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML
Nice to Have:
● Experience with Databricks
● Knowledge of AI/ML concepts and tools
● Certification in relevant technologies
What We Offer:
● Competitive salary and benefits
● Opportunity to work on cutting-edge projects
● Collaborative and dynamic work environment
● Professional growth and development opportunities
● Remote work opportunities & flexible hours
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and evolve Atlassian’s central Micros platform services, improving reliability, observability, deployment, operations, and developer experience at massive scale. Support the transition from AWS to multi-cloud infrastructure involving GCP and Kubernetes. Collaborate with platform and product teams across Australia and India and contribute to major platform engineering initiatives across Core Engineering.
Top Skills:
AWSCloud InfrastructureGCPKubernetesMicroservicesMulti-CloudPlatform-As-A-Service (Paas)
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a distributed engineering team within Atlassian’s Jira Service Management IT Operations organization. Drive high-quality software delivery, architecture, reliability, and customer-facing product development for large-scale cloud services. Partner with Product and Design on roadmaps and outcomes, remove blockers, establish goals and metrics, and coach engineers and emerging leaders while fostering an inclusive, high-performing culture.
Top Skills:
Agentic WorkflowsAutomated TestingCloud ComputingDistributed SystemsItomItsmJira Service ManagementMicroservicesSaaS
Cloud • Information Technology • Security • Software
Lead complex, cross-functional software engineering initiatives for JumpCloud’s device management platform. Responsibilities include architecture, technical strategy, solution design, development of highly available and performant services, requirements discovery, collaboration with product and UX teams, mentoring engineers, and driving projects across multiple teams. The role requires deep expertise in device management across major operating systems, cloud platforms, distributed systems, microservices, databases, Kubernetes, and CI/CD.
Top Skills:
AndroidApple Push Notification ServiceAWSAzureCi/CdDatabasesDistributed SystemsGCPGithub ActionsGoiOSJavaKubernetesLinuxmacOSMicroservicesSaaSTypescriptWindows
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
