Photon Jobs

Lead Data Engineer - Data Archival - Bangalore

Photon

Lead Data Engineer - Data Archival - Bangalore

Reposted One Month Ago

Be an Early Applicant

Remote

Hiring Remotely in India

Mid level

Remote

Hiring Remotely in India

Mid level

Design, build and maintain cloud-oriented big data solutions for ingestion, processing, cleaning and exposition. Improve data quality, implement ETL and data-warehouse architectures, and collaborate with DDS/Data Foundation teams to ensure platform reliability.

The summary above was generated by AI

Missions

Job description:

Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

Today we manage SG Data platform service offers and data tools:

·       Data ingestion: to ingest the data from a data source

·       Data processing: to process, transform and distribute the data to the target location

·       Data exposition : to distribute and expose the data hosted in the data platform

·       Data cleaning: to purge the data on the Lake in a secure way

·       Data tools: data formatter, data anonymizer

   As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile

Experience: 3-5 Years
Skills:

-       Computer programming: Spark, Scala, Java, Python

-       Operating system knowledge for Unix, Linux

-       Databases and SQL

-       ETL and data warehousing

-       Hadoop

-       Apach Spark

Tasks:

·       Maintain an excellent service level of the platform and avoid issues.

·       Researching new methods of obtaining valuable data and improving its quality

·       Creating and enhancing data solutions using various programming languages and tools

·       Creating and enhancing data architectures that meet the requirements of the business

·       Communicate inside if the tech league group to find new approaches

Similar Jobs

Atlassian

Senior Software Engineer

4 Hours Ago

In-Office or Remote

Senior level

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Design, build, and operate Atlassian’s foundational data platform, including Flink streaming ingestion and MPP query systems such as StarRocks. The role owns architecture, production reliability, performance, cost, data quality, observability, code reviews, complex problem resolution, cross-team initiatives, and mentoring. Candidates need strong distributed-systems and data-engineering expertise, coding skills in Java, Scala, or Python, cloud infrastructure experience, and operational experience with high-scale platforms.

Top Skills: Apache DorisApache FlinkApache PinotSparkAWSGCPJavaPythonScalaStarrocksTrino

Atlassian

Software Engineer

4 Hours Ago

In-Office or Remote

Mid level

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Build full-stack software features, REST APIs, customer-facing React components, backend monitoring, CI/CD pipelines, content management integrations, and reliable services. The role requires collaboration with engineering, UX, and visual design teams, plus experience with JavaScript/TypeScript, Java, React, Node.js, cloud platforms, REST integrations, enterprise content management systems, and related server technologies.

Top Skills: AWSCi/CdCSSDockerEnterprise Content Management SystemsEs6ExpressFreemarkerGitHTMLJavaJavaScriptNginxNode.jsNpmReactRest ApisRustSassTypescript

Micron Technology

Principal Engineer

Yesterday

Remote

Gujarat, IND

Senior level

Artificial Intelligence • Hardware • Information Technology • Machine Learning

Lead equipment engineering for assembly manufacturing to improve safety, quality, reliability, productivity and cost. Drive equipment strategy, lifecycle management, automation, Lean/Six Sigma improvements, and AI-enabled predictive maintenance and analytics. Build team capability, deploy Industry 4.0 solutions, and partner across functions to meet OEE, downtime, and productivity targets.

Top Skills: AIApcCopilot TechnologiesData AnalyticsDigital TwinFdcGenerative AiIndustry 4.0Intelligent AutomationIotMachine LearningManufacturing IntelligenceMesPredictive MaintenanceSpcStatistical Process Control

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.