No applications. Teams find and message you directly.
Top Selection is looking for a Senior Data Engineer for ETL migration projects. Remote work with a salary range of 270,000 to 285,000 ₽ per month.
Top Selection is looking for a Senior Data Engineer for ETL migration projects. Remote work with a salary range of 270,000 to 285,000 ₽ per month.
Responsibilities
- Migration of ETL systems from Oracle/Informatica to Apache stack (S3, Airflow, NiFi, Kafka, Greenplum)
- Transfer business logic from Informatica to high-performance SQL code
- Write and optimize SQL for data marts and ETL processes
- Develop DAGs in Airflow
- Configure pipelines in NiFi (sources: Oracle, PostgreSQL; receivers: S3, file archives)
- Develop Spark jobs (PySpark) for large volumes
- Integrate with Kafka for streaming
- Set up monitoring (Grafana/Prometheus) and track metrics
- Analyze incidents related to data quality and loading errors
- Conduct code reviews
Requirements
- Experience in migrating ETL systems (preferably from Oracle/Informatica to Apache stack)
- Deep SQL knowledge: window functions, complex joins, hierarchical queries
- SQL optimization for high load (partitioning, indexes, explain plans)
- Experience with Oracle (PL/SQL) and PostgreSQL
- Knowledge of Greenplum and/or Clickhouse
- Designing architectures on Apache Spark (PySpark), NiFi, Airflow
- Familiarity with Hadoop (HDFS) and Hive
- ETL monitoring: Grafana/Prometheus or Victoria Metrics
- Experience with billing systems (preferably in telecom domain)
- Will be a plus: