Role in brief
Rain Xyz is seeking a Data Engineer to develop scalable data pipelines for their stablecoin payments platform. Ideal candidates have experience with SQL, Python, and Rust, and are comfortable working in a flexible, remote environment.
About the role
As a Data Engineer at Rain Xyz, you will be responsible for building and maintaining scalable batch and streaming data pipelines that support the company's global stablecoin payment solutions. This role involves working closely with Analytics Engineers, Data Scientists, and Risk teams to ensure data integrity and availability across various platforms.
Rain is a rapidly growing company that values an open and flat structure, allowing team members to explore ideas and influence the company's roadmap. Success in this role means delivering robust data solutions that enhance the performance and reliability of Rain's financial infrastructure.
Skills that matter here
- SQL: You will use SQL to design and implement data solutions at scale.
- Python: Python will be essential for building and orchestrating data pipelines.
- Rust: Rust may be utilized for performance-critical components within data solutions.
- BigQuery: Experience with BigQuery is important for managing cloud data warehousing.
- Kafka: Kafka will be used for handling streaming data efficiently.
- dbt: You will leverage dbt for building and managing data models.
Who this role suits
- Has a strong background in building production data solutions.
- Enjoys working in a flexible and collaborative environment.
- Is proactive in problem-solving and debugging across data systems.
- Values personal growth and is eager to influence company direction.
From the employer
What you’ll do
- Build scalable batch and streaming pipelines, choosing the right approach for latency, cost, and correctness.
- Process events near real time, handling deduplication, windowing, and late or out-of-order events.
- Own batch ingestion from databases (CDC), files (SFTP and GCS), APIs, and onchain sources.
- Build incremental dbt models that handle late data, duplicates, CDC deletes, and backfills; reconcile streaming and batch outputs.
- Orchestrate pipelines in Dagster with sensors, schedules, and alerts.
- Add freshness, volume, and reconciliation checks to every source, and fix root causes.
- Work with backend pods on event and table contracts to prevent downstream breakage.
- Partner with Analytics Engineers, Data Scientists, and Risk on their data needs, including ML features.
What you’ll need
- At least 3 years building production data solutions, including owning both batch and streaming pipelines end to end, from source to warehouse.
- Experience designing data solutions at scale.
- Strong SQL and Python / Rust, plus experience with a cloud data warehouse such as BigQuery, ClickHouse, or Snowflake and an understanding of their trade-offs.
- Streaming experience with tools such as Pub/Sub, Kafka, Dataflow/Beam, or Flink.
- Batch experience with dbt and an orchestrator such as Dagster or Airflow.
- Experience with production data quality testing, monitoring, and reconciliation.
- Ability to debug across the source database, pipeline, warehouse, and report.
- Ability to use AI tools to learn and work faster while checking their output.
Things that enable a fulfilling, healthy and happy experience at Rain:
- Flexible time off 🌴 Unlimited vacation can be daunting, so we require Rainmakers to take 10 days minimum for themselves.
- Flexible working ☕ We support a flexible workplace – work from home, come into an office, or both. We want everyone to work in an environment where they're their most confident and productive selves. New Rainmakers receive a stipend to set up a comfortable home workspace.
- Easy to access benefits 🧠 For US Rainmakers, we cover 95% of your health, dental, and vision plan costs and 90% for your dependents, plus a 100% company-subsidized life insurance plan.
- Retirement goals 💡 Plan for the future with confidence. We offer a 401(k) with a 4% company match.
- Equity plan 📦 Every Rainmaker gets an equity option plan so we all benefit from our success.
- Health and Wellness 📚 High performance begins from within. Rainmakers receive a monthly stipend to be used for eligible health and wellness spending like gym memberships/fitness classes, massages, acupuncture - whatever recharges you!
- In-office meals 🍜 Rainmakers working from the office enjoy lunch and dinner on us, covered with a DoorDash credit.
- Team summits ✨ Summits play an important role at Rain. Time together helps us build relationships and a common destiny. Expect team and company offsites, both domestic and international.
Questions about this role
Is this position remote?
Yes, this role is fully remote.
What level of experience is required?
Candidates should have at least 3 years of experience in building production data solutions.
How do I apply for this role?
You can apply through the company's website at https://www.rain.xyz/?ref=sailonchain.com.
✓ Drop your CV once, then continue to the employer's application form. Your profile stays here for every recruiter hiring on web3vacancy.