Build a world-class, high-volume data system from the ground up! We have growing data sets and several exciting Machine Learning systems to create or improve, including automated diagnosis of equipment, network anomaly detection and mitigation, and intelligent RF network optimization and technical support automation using LLMs. We are looking for experienced Data Engineers who can help us make progress on these projects quickly.
In your first year at Tarana, you will design highly scalable and performant systems. You will design and implement a detailed data architecture/data model and solidify our ELT pipelines as part of a fast-moving, disciplined, and methodical data team.
These deliverables will focus on
- Data Modeling
- Pipeline design, implementation and deployment
- Pipeline performance optimization
- Cluster design and optimization
- Query performance optimization
- Data tool analysis and selection
- Data preparation
- Data monitoring and visualization
- System integration
You will work closely with cloud and device engineers, network engineers, DevOps engineers, domain experts and the Data Science team to implement your plan.
This is a hands-on technical role: you will be doing the heavy technical lifting as we grow the team. You must work well with others: you will need to interact with people across the organization to successfully build and maintain a high volume data architecture.
Required Skills and Experience:
- BE/ME/M.Tech/MS or higher in Computer Science
- 5-12 years of experience building large-scale systems or ML/AI pipelines
Knowledge, Skills and Abilities Needed:
- Strong skills in scripting languages (mainly python, bash) required
- Java programming
- Experience with AWS ecosystem
- Experience with data integration tools, data governance tools and data quality tools
- Experience with data warehousing and end-to-end data platforms such as DataBricks, Snowflake, BigQuery and/or Redshift/SageMaker
- Scala experience a plus
- Highly collaborative, team-oriented approach
- Passionate and excited about working in a fast moving startup with exciting projects and opportunities for growth
