At Atlan, we are both proud and humbled by the fact that we are building products that power data teams in more than 50 countries around the world, ranging from small startups to Fortune 500 giants. Our products form the very backbone of our users, have become a part of their daily workflows and directly impact their success.
In the past decade, products like GitHub helped companies build great engineering cultures. At Atlan, we are on a quest to help build winning data teams of the future. Every line of code we write, every feature we add, every pixel we create—everything we do—is to help data teams around the world do their lives’ best work.
Let’s show the world how it’s done!
We are currently hiring an experienced Senior Software Engineer with expertise in building distributed systems in Java leveraging Cassandra & Elastic Search. This role requires prior experience building data platforms focusing on ingestion, storage & consumption for both batch & streaming data.
Familiarity with optimizing Elastic Search instances for search query & latency and event consumption, Kafka cluster management is a big plus.
Key Responsibilities:
Metadata Consumption Optimization: Spearhead efforts to reduce search and graph lookup times to sub-second latency, enhancing the overall performance of our platform.
Storage & Consistency Enhancement: Optimize storage mechanisms and consistency protocols for handling large datasets efficiently and reliably.
Background Tasks Management: Develop robust solutions for managing resource-intensive background tasks, ensuring smooth operation of our systems under heavy workloads.
Metadata Ingestion Systems: Lead the design and implementation of systems capable of ingesting millions of data assets per hour, supporting the seamless integration of diverse datasets into our platform.
Requirements:
Experience: 7+ years of proven experience in the development of distributed systems, with a track record of delivering high-performance, scalable software solutions.
TechnicalProficiency: Strong proficiency in Java and Spring framework is essential.
Experience with Elasticsearch, Cassandra, and JanusGraph will be highly advantageous.
Expertise: Demonstrated expertise in at least one of the specified areas, with a deep understanding of the underlying principles and best practices.
Success Metrics:
Technical Mastery: Rapid familiarity with our codebase and technical stack, coupled with active contributions to ongoing projects.
Leadership: Assume a leadership role on a core project, providing mentorship to junior engineers and driving innovative solutions.
Subject Matter Expertise: Become a recognized Subject Matter Expert (SME) in a critical area, making significant contributions to the performance and scalability of our platform.
Ideal Candidate Profile:
Design and Implementation Skills: Proven ability to design and implement complex distributed systems, coupled with a strong grasp of architectural principles.
Backend Services Development: Experience in building highly scalable and reliable backend services, with a focus on performance optimization and fault tolerance.
Problem-solving Abilities: Strong analytical and problem-solving skills, with a knack for tackling challenging technical issues.
Communication: Excellent written and verbal communication skills, essential for effective collaboration within cross-functional teams.
Collaborative Mindset: A collaborative team player with a growth mindset, eager to learn, share knowledge, and contribute to collective success.
Do your life’s best work at Atlan 🚀
At Atlan, our mission is to help data teams do their life's best work. Inside Atlan, our goal is to help Atlanians do their life's best work while at Atlan and reach their Ikigai.
Working at Atlan 👨💻 👩💻
We love open-source. One of our open-source projects was trending worldwide on GitHub.
Read about our 10 engineering commandments
The why, what, and who of internships at Atlan
Engineering demos: How we share knowledge and build better engineering culture
Going from great people to greater teams: How we think about growth at Atlan
Top Skills
What We Do
Built by a data team for data teams, Atlan is the active metadata platform for the modern data stack. It stitches together metadata from various sources (Snowflake, dbt, Databricks, Looker, Tableau, Postgres, etc.) to create a unified data discovery, cataloging, lineage, and governance experience across all your data assets, from columns and queries to metrics and dashboards. Atlan facilitates a two-way movement of metadata, bringing context back into the tools and workflows that your data team uses every day — for example, in your BI tool when you wonder what a metric on the dashboard means.
A pioneer in the space, Atlan was named a Leader in Forrester Wave™️: Enterprise Data Catalogs for DataOps in 2022 and was recognized by Gartner seven times in 2021, including as a Cool Vendor in DataOps and in the inaugural Market Guide for Active Metadata Management. Today, we power pioneering data teams like WeWork, Plaid, Postman, Unilever, and Ralph Lauren. We recently raised a Series B, backed by top investors (including Insight Partners, Sequoia, and Salesforce Ventures) and founders & CEOs from the modern data stack (including Snowflake, Looker, and Stitch).
For more information, visit http://www.atlan.com/ or follow us on Twitter at AtlanHQ.
