Who you are

• You have ~5+ years of experience in software engineering with demonstrated experience in data processing, ETL pipelines, or similar data-intensive systems
• You have experience with data modeling, entity resolution, and record linkage, including multi-system resolution strategies across relational and non-relational data stores
• You have experience with relational databases query tuning and working effectively with ORMs in high-throughput, data-rich applications
• You're experienced in one or more OOP languages and modern OOD
• You're comfortable troubleshooting across caching, queuing, load-balancing, storage, and distributed services layers, particularly as they relate to data processing workflows
• You can diagnose and improve high-volume data performance issues systematically
• You can effectively contribute to technical strategy and roadmaps on product-oriented teams, particularly around data architecture decisions
• You communicate nuanced ideas clearly, whether you're explaining complex data processing decisions in writing or brainstorming pipeline optimizations in real-time
• You demonstrate strong ownership instincts and sweat the details, especially critical when dealing with data quality and accuracy
• You're excited to work on a cross-functional team, partnering with product stakeholders, other engineering teams, and data subject matter experts
• Experience with event-driven architecture and Kafka for real-time data processing
• Experience with data pipeline orchestration tools and frameworks
• A combination of startup and brand-name SaaS companies experience, particularly with data-heavy products
• Experience with Python or Ruby

What the job involves

• As a Senior Software Engineer on our Data Platform team, you'll have the opportunity to own and evolve our core data pipelines that power the enrichment of company and people data in our CRM. You'll be responsible for understanding, optimizing, and scaling the systems that create our core entities, associate enrichment data, and fan out processed information to our tenanted customers
• Become the deep expert in our data processing pipelines, lead the technical design of critical data initiatives, and be an active code contributor during execution phases
• Evaluate existing data processing systems to understand current workflows and identify optimization opportunities around reliability, performance, and scalability
• Own the evolution of our core entity creation and resolution systems for company and people records, ensuring accurate deduplication and association logic
• Ensure our data pipelines are architecturally consistent, adaptable and extensible according to changing business needs and growing data volumes
• Collaborate across team boundaries to align on and coordinate changes, as this team manages data models that have critical touchpoints upstream and downstream
• Research and propose new technologies that drive the team's critical data processing systems while considering performance, scalability, and reliability implications
• Own the end-to-end quality of the data that is surfaced to customers through modern evaluation techniques and measurement
• Our platform is built with React and TypeScript on the front end, with Ruby and PostgreSQL on the back end. We're leaning into event-driven architecture using Kafka. Our infrastructure is hosted by AWS and runs on Kubernetes. Our Data stack is mainly on AWS which enables technologies such as Spark, Python, Kubernetes, Kafka, Databricks, Sagemaker

Benefits

• Daily lunches
• Commuter passes
• Flexible PTO
• Free events
• Tech pack
• Retirement options
• Work from home opportunities
• Health insurance
• Grocery allowance