[Remote] Software Engineer, Data Platform
Note: The job is a remote job and is open to candidates in USA. Whatnot is the largest live shopping platform in North America and Europe, seeking a Software Engineer for their Data Platform team. The role involves leading the development of critical data systems, designing scalable infrastructure, and collaborating with cross-functional teams to enhance real-time analytics and stream processing capabilities.
Responsibilities
- Define technical direction and lead development of critical data platform systems that power next-generation capabilities at Whatnot
- Lead the buildout and evolution of our Flink platform, helping drive stream processing from early platform investment to production-ready usage across the company
- Design scalable, reliable, multi-tenant streaming infrastructure rather than simply building pipelines on top of an existing platform
- Own core platform concerns including scalability, performance, reliability, SLOs, and operational excellence for stream processing systems
- Build high-quality systems that support real-time analytics, event-driven applications, and machine learning infrastructure needs across Whatnot
- Make key decisions about how data systems should be integrated across Whatnot, and then partner cross-functionally to bring that architecture to life
- Collaborate closely with engineering partners across product, platform, machine learning, and data to enable fast, safe, and scalable development
- Help shape broader company architecture across stream processing, real-time systems, analytics, and content understanding
Skills
- 5+ years of experience
- Ability to write well-tested, API-driven applications and services that run at scale in production
- Track record of building scalable, high-performance distributed systems
- Strong experience with streaming data systems such as Kafka, Flink, or Pulsar, with particular strength in building or evolving the platform layer itself — not just downstream pipelines
- Hands-on experience designing and operating stateful real-time data pipelines at scale, including concepts like checkpointing, state management, and watermarking
- Experience evaluating architectural tradeoffs in stream processing systems, including when Flink is the right solution and when it is not
- Experience building multi-tenant or end-to-end streaming infrastructure that supports multiple teams or production use cases
- Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) for processing and serving data products
- Strong experience supporting operational systems to ensure uptime, reliability, and maintainability, including monitoring, alerting, and incident management
- Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (for example, Terraform)
- Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles
- Self-starter ethic, with the ability to thrive under a high level of autonomy
- Exceptional interpersonal and communication skills
Benefits
- Generous Holiday and Time off Policy
- Health Insurance options including Medical, Dental, Vision
- Work From Home Support
- Home office setup allowance
- Monthly allowance for cell phone and internet
- Monthly allowance for wellness
- Annual allowance towards Childcare
- Lifetime benefit for family planning, such as adoption or fertility expenses
- Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
- Monthly allowance to dogfood the app
- 16 weeks of paid parental leave + one month gradual return to work company leave allowances run concurrently with country leave requirements which take precedence.
Company Overview
Company H1B Sponsorship