No longer accepting applicationsThis role at Wildberries has closed. Browse live web3 jobs instead.
Get Discovered
No applications. Teams find and message you directly.
Get discovered. Join the talent poolNo account needed · 0 people in the pool→
No account needed. Teams find you and reach out directly.
0 people already in the pool
◆ 6/10
techData Engineerhybrid
About this role
Wildberries is looking for a Data Engineer with at least 3 years of experience to design and develop data pipelines and ensure data quality.
Description
Wildberries is looking for a Data Engineer with at least 3 years of experience to design and develop data pipelines and ensure data quality.
Responsibilities
Responsibilities
- Design and develop data loading pipelines optimally based on consumer team needs.
- Design data loading, layer distribution, and data marts in ClickHouse: choose table engines, sorting keys, partitioning, sharding, and replication keys.
- Optimize queries and storage: investigate slow queries or unexpected table growth and fix issues.
- Develop and maintain DAGs in Airflow: idempotency, retries, backfills, task dependencies.
- Ensure data quality: completeness and consistency checks, system reconciliations, alerting, and monitoring of pipelines.
- Work directly with product teams and analysts: clarify requirements, negotiate data contracts, explain limitations, and suggest alternatives.
Requirements
Requirements
- Experience with ClickHouse (key skill for this position; must identify cluster issues, understand how to work with distributed DBs, and optimally build pipelines).
- Proficient in SQL, working with large volumes (we have tables over 50+ Tb).
- Proficient in Python for pipeline development, and sometimes backend on FastAPI.
- Experience with Apache Airflow (developing and operating DAGs in production, understanding idempotency and backfills).
- Experience with Apache Kafka (understanding the model: topics, partitions, consumer groups, offsets, delivery semantics, experience building loading from Kafka to storage).
- Experience integrating data from REST APIs and relational DBs (PostgreSQL and similar), including incremental loading and working with data changes.
Job Details
Market range (est.)$90k–$180k
LocationHybrid
AI Score★★★★★★☆☆☆☆ 6/10
PostedSep 20, 2026 (22d ago)
Tags & Skills
techData Engineerhybrid
Tech Stack
ClickHouseSQLPythonFastAPIApache AirflowApache KafkaREST APIPostgreSQL