Who are we?
Smarsh empowers its customers to manage risk and unleash intelligence in their digital communications. Our growing community of over 6500 organizations in regulated industries counts on Smarsh every day to help them spot compliance, legal or reputational risks in 80+ communication channels before those risks become regulatory fines or headlines. Relentless innovation has fueled our journey to consistent leadership recognition from analysts like Gartner and Forrester, and our sustained, aggressive growth has landed Smarsh in the annual Inc. 5000 list of fastest-growing American companies since 2008.
We are seeking a visionary and highly skilled Engineer to take a role in building a cutting-edge Internal Developer Portal (IDP). This position focuses on developing scalable integrations, APIs, and solutions that make the IDP a central hub for empowering developers and enabling fast, data-driven decisions. You will collaborate with cross-functional teams to design the IDP with features such as event-based architectures, advanced data visualizations, and robust queuing systems to streamline workflows and enhance the developer experience. If you are passionate about developer tools, clean code, and creating systems that transform decision-making through data, we want you on our team.
Key Responsibilities
- IDP Design and Architecture
- Design the IDP as a central hub that integrates seamlessly with existing systems and tools, enabling teams to make informed and faster decisions.
- Design the IDP with an event-driven architecture to ensure real-time data flow, scalability, and responsiveness.
- Implement queuing systems (e.g., Kafka, RabbitMQ, or Amazon SQS) to handle high-throughput data ingestion and processing reliably.
- Ensure the IDP adheres to principles of scalability, modularity, and extensibility, allowing teams to build on top of it with minimal friction.
- API Development and Integration
- Develop high-performance APIs to aggregate and push data into the IDP, enabling smooth and secure interactions between systems.
- Create reusable integrations for third-party tools (e.g., CI/CD systems, monitoring platforms, container registries and many more) to consolidate workflows.
- Ensure APIs are well-documented, versioned, and meet performance, security, and compliance standards.
- Data Processing and Visualization
- Build advanced data pipelines to process, transform, and aggregate data from various sources for visualization and actionable insights.
- Work with stakeholders to identify key metrics and design intuitive dashboards and visualisations that make data actionable and meaningful.
- Design systems for data parsing and transformation, including robust handling of YAML, JSON, and other serialization formats to normalize inputs from disparate sources.
- Centralised Decision Enablement
- Design the IDP to surface relevant information, alerts, and trends, empowering users to make fast, informed decisions.
- Enable personalised data views based on user roles, ensuring individuals see insights relevant to their responsibilities.
- Integrate recommendation engines to provide proactive suggestions for optimising workflows, debugging issues, or improving deployments.
- Security and Compliance
- Embed Role-Based Access Control (RBAC) to enforce least-privilege principles and secure all IDP interactions.
- Implement automated security checks, such as API authentication, data encryption, and compliance validation.
- Design scorecards and monitoring systems that track security posture, highlighting vulnerabilities and compliance gaps.
- Collaboration and Leadership
- Collaborate with DevOps, Security, and Engineering teams to align the IDP with organizational goals and developer needs.
- Act as a technical mentor, guiding junior engineers and driving a culture of technical excellence and innovation.
- Partner with stakeholders to prioritize features and enhancements that maximize IDP adoption and value.
- Open Source Contribution and Community Building
- Lead open-source initiatives that align with the IDP's vision and contribute to the broader developer ecosystem.
- Engage with the community through blogs, meetups, and conference presentations to share insights and learnings.
Required Skills and Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
- Technical Expertise
- Advanced proficiency in Python with experience building scalable, high-performance systems.
- Deep understanding of event-driven architectures, queuing systems, and real-time data processing (e.g., Kafka, RabbitMQ, Amazon SQS).
- Strong experience with API frameworks like FastAPI, Django Rest Framework, or Flask.
- Expertise in data serialization formats (e.g., JSON, YAML) and data transformation techniques.
- Integration and DevOps
- Proven experience integrating third-party tools like Jenkins, GitLab, Prometheus, and AWS services.
- Strong knowledge of Kubernetes, Docker, and cloud platforms (AWS, GCP, Azure).
- Experience with Infrastructure-as-Code tools (e.g., Terraform, Pulumi) and GitOps practices (e.g., ArgoCD).
- Data Processing and Visualization
- Expertise in building data pipelines and ETL workflows with a focus on reliability and scalability.
- Strong knowledge of relational and non-relational databases such as PostgreSQL, MongoDB, or similar.
- Security and Compliance
- In-depth knowledge of RBAC, API security best practices, and compliance frameworks (e.g., SOC 2, GDPR).
- Proven ability to implement real-time security scorecards and monitoring tools.
- Soft Skills
- Exceptional leadership and communication skills, with the ability to articulate complex technical concepts to diverse audiences.
- Analytical and problem-solving mindset, with a focus on delivering impactful solutions.
Preferred Qualifications
- Hands-on experience with Internal Developer Portal (IDP) tools like Port or Backstage.
- Experience with testing frameworks like pytest or unittest, with a focus on automation.
- Exposure to advanced concepts like A/B testing for IDP workflows and feedback loops for continuous improvement.
About our culture
Smarsh hires lifelong learners with a passion for innovating with purpose, humility and humor. Collaboration is at the heart of everything we do. We work closely with the most popular communications platforms and the world’s leading cloud infrastructure platforms. We use the latest in AI/ML technology to help our customers break new ground at scale. We are a global organization that values diversity, and we believe that providing opportunities for everyone to be their authentic self is key to our success. Smarsh leadership, culture, and commitment to developing our people have all garnered Comparably.com Best Places to Work Awards. Come join us and find out what the best work of your career looks like.
