Rust - Python - Data & Backend Engineer

Do you love backend plumbing & processing data? This area has undergone several innovations in the past, with the latest being cloud-native object storage, specialized databases (ScyllaDB, RocksDB, DuckDB, etc.), and systems programming languages (notably Rust and extensions to dynamic languages like Python) that deliver non-compromising performance and efficiency. At our startup, we have many backend systems, and PBs of data in various forms. We need someone that is experienced in modern cloud tooling, and can skillfully access, transform, and ingest data. We need someone that stays close to the computing fundamentals, meticulous in execution, and can craftily string together databases, queues, web servers, and pipelines.

About the Startup

Our startup is the leading provider of public safety technologies to US law enforcement, state, and federal agencies. Our mission is to help investigators solve crimes and prevent financial fraud with responsible use of our platform. We serve hundreds of active agency customers, and see large volumes of monthly search activity. The right candidate has a versatile mind that understands the complexity of the modern web and public data landscape to realize this mission.

At Engineering, team members have significant scope for ownership, and lots of room to grow. We take a forward-looking approach to growth, e.g. promoting our work through technical blog posts, conference presentations, and open source initiatives. Team members could grow into leads/managers, or deepen their technical expertise as individual contributors.

Responsibilities

• Architect backend systems with the right choices of technical components.
• Develop and maintain backend servers and pipelines with a focus on performance and efficiency.
• Develop and maintain in-house databases and indexes, and adopt compatible and mature solutions to enrich the team’s technology infrastructure.
• Optimize across the backend/data Python stack, with more suitable architecture or Rust extension modules.
• Work with PB-scale data on cloud storage, create storage patterns and write accessors for the product stack to serve user queries.
• Extract and transform TBs of hot data between different storage backends to generate insights and carry out migrations.

Requirements

• Strong familiarity with the Python backend/data ecosystem, e.g. NumPy, Pandas, Polars, etc.
• Proficiency with systems languages (prefer Rust), and computing fundamentals.
• Strong experience with high-performance databases, e.g. ScyllaDB, RocksDB, DuckDB and mastery of common query patterns, such as point lookup and parallel iterator scans.
• Strong familiarity with common data formats, e.g. MessagePack, Protobuf, Arrow, Parquet, etc.
• A proven record of implementing data intensive systems, and working knowledge debugging common bottlenecks.
• Experience with job queues for data pipelines, e.g. Redis, Celery, Amazon SQS, etc.
• 4+ years of experience in data engineering or systems programming.
• BS/MS in Computer Science, Engineering, or equivalent experience.
• Experience working in cross-functional teams.

Bonus Requirements

• Hands-on experience with vector data, in archival log formats or vector indexes/databases, e.g. Faiss, HNSWLIB, Qdrant.
• Experience writing Python extensions in Rust/C++, or general cross-language interfaces.
• Public GitHub and portfolio repositories showcasing an organic interest in systems engineering.

Our Tech Stack

• Languages: Python, Rust
• Databases: In-house implementations of deca-billion scale vector indexes, K-V stores, ScyllaDB, Qdrant
• Dev tools: Docker, Docker Compose

Benefits

• Medical, Dental, Vision, Life Insurance, STD and LTD Plans
• FSA - Medical and Dependent Care
• EAP and wellness programs
• Productivity stipends
• 13 Paid Holidays
• Unlimited PTO
• Flexible work environment - 100% remote
• Bi-annual company/team meetups
• 401(k) plan with employer matching contributions
• Annual review for salary raises

Compensation

• Base Salary: $150,000–$200,000
• Equity: Participation in company stock plan
• Bonus: Annual target bonus of 10% (based on performance)

Actual compensation depends on experience, skills, and location.

Application Questions

To apply, please answer the following questions:

• What are you most passionate about when it comes to backend & data systems? What have you done for it in the past?
• What is your experience with Python and Rust? Any Rust project related to data processing that you worked on? Please reference a project link if public.
• What are some of the notable backend services you have worked on directly in your previous positions?
• Do you have a GitHub page or portfolio/project site? Please post some projects or blog posts that best capture your work/thoughts.
• Are you currently located in the US?
• What is your salary expectation?

Send your answers and resume to data.startup@rustjobs.dev