𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀
𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟮𝟬𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟯𝟬𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟮𝟬-𝟯𝟬 𝗟𝗣𝗔)
Experience: 3+ yrs
Location: Remote
As a Data Engineer, you will design, build, and maintain scalable data pipelines and analytics platforms that drive business insights and product innovations. Leveraging your expertise in Python and SQL, you will transform raw data into clean, structured datasets, enabling data scientists and product teams to accelerate experimentation. You will integrate Posthog for behavioral analytics, employ deepeval for model validation workflows, and use Streamlit and LangChain to create interactive data tools and prompt-based applications. Your role will ensure data quality, performance, and compliance across the organization while collaborating closely with cross-functional stakeholders to translate data needs into technical solutions.
Requirements
𝗞𝗲𝘆 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀
• Design and implement robust ETL pipelines that ingest, transform, and store data from diverse sources into a unified data warehouse.
• Build and maintain dashboards and data visualizations using Streamlit to provide real‑time insights for product, marketing, and engineering teams.
• Integrate Posthog event data into the analytics pipeline and create segmented user funnels for product optimization.
• Develop and maintain LangChain workflows to power conversational AI features that interact with structured data.
• Employ deepeval to automate evaluation of machine learning models, ensuring model performance aligns with business KPIs.
• Optimize SQL queries and database schemas for speed, reliability, and scalability across large datasets.
• Collaborate with data scientists to provision and manage queryable data lakes and data marts.
• Implement data governance, security, and privacy controls to comply with industry regulations.
• Monitor pipeline health, troubleshoot failures, and iterate on performance enhancements.
• Document data architecture, pipeline logic, and best practices for internal and external stakeholders.
𝗪𝗵𝗮𝘁 𝗠𝗮𝗸𝗲𝘀 𝗬𝗼𝘂 𝗮 𝗚𝗿𝗲𝗮𝘁 𝗙𝗶𝘁
• 3+ years of professional experience building data pipelines and analytics platforms in a production environment.
• Strong programming skills in Python, with extensive experience in writing reusable, testable code.
• Deep knowledge of SQL and experience with modern database systems such as PostgreSQL, BigQuery, or Snowflake.
• Proven track record of integrating Posthog for behavioral data ingestion and analysis.
• Hands‑on experience with deepeval or similar model evaluation frameworks.
• Familiarity with LangChain for building LLM‑driven data workflows and prompt engineering.
• Solid understanding of Streamlit or comparable open‑source toolkits for building interactive dashboards.
• Ability to collaborate effectively with cross‑functional teams in a remote, agile environment.
• Strong problem‑solving mindset, with the capacity to troubleshoot complex data issues under tight deadlines.
• Commitment to code quality, documentation, and continuous learning in the fast‑moving data engineering landscape.
