JD – Data Engineer

Tools & Technologies

• Primary: Python, SPSS , SQL (via DBeaver, SSMS) 
• Others: AWS S3, Visual Studio Code

Key Responsibilities

• Survey Data Management:
  • Download completed survey data in SPSS format post-fieldwork closure.
  • Execute SPSS syntax as required before initiating data processing.
• Data Preparation & Processing:
  • Prepare Ad List files provided by the research team prior to data processing.
  • Upload all relevant files into designated AWS S3 project folders.
  • Develop and execute project-specific Python scripts to process data and ingest it into the database.
  • Run update configurations post-processing to refresh dashboards and ensure unique IDs are correctly updated.
• Workflow Management:
  • Manage separate workflows for media uploads using Python.
  • Collaborate with Project Managers (PM) and Research Executives (RE) for custom updates, data QC, and dashboard pipeline setup.
• Data Engineering & Quality Control:
  • Work closely with engineering teams to establish new dashboard data pipelines.
  • Ensure data integrity and compliance with MR standards, including norms, data stacking, and weighting methodologies.

Required Skills & Qualifications

• Technical Expertise:
  • Strong proficiency in Python for data processing and automation.
  • Experience with SPSS for survey data handling and syntax execution.
  • Solid understanding of SQL for database operations.
  • Familiarity with AWS S3 for file management and cloud workflows.
• Domain Knowledge:
  • Background in Market Research data processing, including norms, data stacking, and weighting methodologies.
  • Understanding of dashboard refresh logic and unique ID management.
• Soft Skills:
  • Excellent problem-solving and analytical skills.
  • Ability to collaborate effectively with cross-functional teams.
  • Strong attention to detail and commitment to data quality.