Design and develop data ingestion frameworks and real-time processing solutions while optimizing and operationalizing data analytics tools in GCP.
It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Responsibilities
- Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open source tools and data processing frameworks.
- Hands-on on technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python, Hadoop Platform, Hive, Presto, Druid, airflow
- Deep understanding of BigQuery architecture, best practices, and performance optimization.
- Proficiency in LookML for building data models and metrics.
- Experience with DataProc for running Hadoop/ Spark jobs on GCP.
- Knowledge of configuring and optimizing DataProc clusters.
- Offer system support as part of a support rotation with other team members.
- Operationalize open source data-analytic tools for enterprise use.
- Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.
- Understand and follow the company development lifecycle to develop, deploy and deliver the solutions.
Minimum Qualifications:
• Bachelor's degree in Computer Science, CIS, or related field
• Experience on project(s) involving the implementation of software development life cycles (SDLC) GCP DATA ENGINEER
Required Skills & Qualifications:
- Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
- 7+ years of experience in data engineering, cloud data solutions, and pipeline development.
- GCP Expertise: Hands-on experience with BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow), Vertex AI, and IAM Policies.
- Programming: Proficiency in Python, SQL, and Apache Beam (Java or Scala is a plus).
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Top Skills
Airflow
Spark
BigQuery
Dataproc
Druid
Hadoop
Hive
Java
Kafka
Presto
Python
Scala
Similar Jobs
Information Technology
Lead and maintain cloud infrastructure on Google Cloud Platform, manage Kubernetes deployments, and implement CI/CD pipelines while supporting junior engineers and optimizing workflows.
Top Skills:
Google Cloud Platform,Github Ci/Cd,Kubernetes,Argo Cd,Argo Workflows,Helm,Prometheus,Grafana,Elk,Python
AdTech • Artificial Intelligence • Digital Media • Marketing Tech
Design and deliver scalable services in Java, mentor engineers, integrate ML models, optimize performance and system stability in a high-volume ad tech environment.
Top Skills:
AerospikeAWSCi/CdGitGradleJavaKafkaMemcachedMySQLScylladbSpring
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Senior Physical Security Analyst oversees physical security strategies, manages security personnel and systems, and conducts risk assessments to ensure compliance and safety.
Top Skills:
Access Control SystemsIntrusion DetectionVideo Surveillance
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
