The Senior Software Engineer will manage survey data, develop Python scripts for data processing, and ensure data integrity for dashboards within AWS S3 cloud workflows.
Job Description:
JD – Data Engineer
Tools & Technologies
- Primary: Python, SPSS , SQL (via DBeaver, SSMS)
- Others: AWS S3, Visual Studio Code
Key Responsibilities
- Survey Data Management:
- Download completed survey data in SPSS format post-fieldwork closure.
- Execute SPSS syntax as required before initiating data processing.
- Data Preparation & Processing:
- Prepare Ad List files provided by the research team prior to data processing.
- Upload all relevant files into designated AWS S3 project folders.
- Develop and execute project-specific Python scripts to process data and ingest it into the database.
- Run update configurations post-processing to refresh dashboards and ensure unique IDs are correctly updated.
- Workflow Management:
- Manage separate workflows for media uploads using Python.
- Collaborate with Project Managers (PM) and Research Executives (RE) for custom updates, data QC, and dashboard pipeline setup.
- Data Engineering & Quality Control:
- Work closely with engineering teams to establish new dashboard data pipelines.
- Ensure data integrity and compliance with MR standards, including norms, data stacking, and weighting methodologies.
Required Skills & Qualifications
- Technical Expertise:
- Strong proficiency in Python for data processing and automation.
- Experience with SPSS for survey data handling and syntax execution.
- Solid understanding of SQL for database operations.
- Familiarity with AWS S3 for file management and cloud workflows.
- Domain Knowledge:
- Background in Market Research data processing, including norms, data stacking, and weighting methodologies.
- Understanding of dashboard refresh logic and unique ID management.
- Soft Skills:
- Excellent problem-solving and analytical skills.
- Ability to collaborate effectively with cross-functional teams.
- Strong attention to detail and commitment to data quality.
Location:
DGS India - Mumbai - Thane Ashar IT ParkBrand:
MerkleTime Type:
Full timeContract Type:
PermanentTop Skills
Aws S3
Python
Spss
SQL
Similar Jobs
Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
The Software Engineer will design, develop, and maintain software products while collaborating in an agile environment, ensuring code quality, and troubleshooting issues.
Top Skills:
AWSDockerGitlabJavaKubernetesNoSQLPythonScalaSQL
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
As a Senior Software Engineer at Coupa, you will develop scalable platforms, build new features, participate in code reviews, and work in an agile environment.
Top Skills:
CSSJavaMySQLPythonReactRuby
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
As a Senior Software Engineer, you will enhance identity security products by developing solutions to customer issues and ensuring code quality, collaborating closely with the engineering team and providing Level 3 support.
Top Skills:
Active DirectoryAjaxAngularjsBootstrapCvsDb2ExtjsGitHibernateJavaJavaScriptJbossJqueryJsfJSONJunitLdapMybatisMySQLOraclePerforceSQLSQL ServerSubversionTestngTomcatWeblogicWebsphereXML
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
