Multiple employees collaborating on work
Atlassian Logo

Atlassian

Senior Data Engineer

Posted 15 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in Bengaluru, Karnataka
Senior level
Remote
Hiring Remotely in Bengaluru, Karnataka
Senior level
As a Senior Data Engineer at Atlassian, you will enhance data ingestion, improve data pipelines, and create scalable micro-services. Collaborating with various teams, you'll work on an AWS-based data lake, focusing on data quality and modern software practices while leveraging technologies like Spark and Airflow.
The summary above was generated by AI

Working at Atlassian
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data Engineering (GTM-DE) team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.
On a typical day you will help our stakeholder teams ingest data faster into our data lake, you'll find ways to make our data pipelines more efficient, or even come up ideas to help instigate self-serve data engineering within the company. Then you will move on to building micro-services, architecting, designing, and enabling self serve capabilities at scale to help Atlassian grow.
You'll get the opportunity to work on a AWS based data lake backed by the full suite of open source projects such as Spark and Airflow. We are a team with little legacy in our tech stack and as a result you'll spend less time paying off technical debt and more time identifying ways to make our platform better and improve our users experience.
As a Senior Data Engineer in the GTM-DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.
On your first day, we'll expect you to have:

  • A BS in Computer Science or equivalent experience
  • At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
  • Strong programming skills (Python, Java or Scala preferred)
  • Experience writing SQL, structuring data, and data storage practices
  • Experience with data modeling
  • Knowledge of data warehousing concepts
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies.
  • A willingness to accept failure, learn and try again
  • An open mind to try solutions that may seem crazy at first
  • Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)


It's preferred, but not technically required, that you have:

  • Experience building self-service tooling and platforms
  • Built and designed Kappa architecture platforms
  • Built pipelines using Databricks and well versed with their API's
  • Contributed to open source projects (Ex: Operators in Airflow)


Our perks & benefits
Atlassian offers a variety of perks and benefits to support you, your family and to help you engage with your local community. Our offerings include health coverage, paid volunteer days, wellness resources, and so much more. Visit go.atlassian.com/perksandbenefits to learn more.
About Atlassian
At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.
We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.
To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.
To learn more about our culture and hiring process, visit go.atlassian.com/crh .

Top Skills

Airflow
AWS
Emr
Hive
Java
Kinesis
Python
Rds
S3
Scala
Spark
SQL
Sqs

Similar Jobs at Atlassian

13 Hours Ago
Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you will work on building and maintaining data pipelines, enabling self-serve capabilities, and architecting data lakes. You'll collaborate with stakeholders to enhance data ingestion processes and improve platform efficiency, using various technologies like AWS, Spark, and Airflow.
Top Skills: AirflowAWSDatabricksHiveJavaPythonScalaSparkSQL
15 Hours Ago
Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you'll build and maintain big data pipelines, enhance a data lake, and develop micro-services. You will work with stakeholders to improve data ingestion and build self-serve capabilities, leveraging technologies like AWS, Spark, and Airflow to process streaming data effectively.
Top Skills: AirflowAWSDatabricksEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
14 Hours Ago
Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Senior Software Engineer will build and ship features in a scalable environment, mentor teammates, ensure monitoring of backend services, and participate in Agile software development. The role requires collaboration with cross-functional teams.

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account