Gate.io is seeking a Data Development Engineer focused on real-time computing to enhance data processing capabilities and ensure data quality and efficiency in a growing environment.
Gate.io has established a comprehensive data warehouse and real-time data system, capable of data collection, computation, storage, and service. As the business scales and real-time application scenarios increase, we are looking to introduce two mid to senior data development engineers responsible for real-time data delivery, task optimization, and engineering governance.
- Analyze, design, and deliver real-time data requirements based on technologies like Flink and Kafka.
- Participate in real-time data warehouse construction and model design.
- Continuously optimize existing real-time tasks to improve stability and efficiency.
- Engage in data governance and engineering quality construction.
- Maintain and troubleshoot big data platforms and computing engines.
- Share best practices and technical experiences to enhance team capabilities.
- Bachelor's degree or higher in Computer Science, Software Engineering, Information Technology, or related fields with 5+ years of data development or big data R&D experience.
- Complete data warehouse project experience with familiarity in real-time data warehouse architecture.
- Proficient in Flink with practical project experience in Flink SQL and DataStream API.
- Experience in real-time task development and optimization.
- Familiarity with Kafka and the complete process of data collection, transmission, computation, storage, and service.
- Knowledge of Hadoop, Hive, Spark, and offline data development capabilities.
- Proficient in SQL for complex data processing and performance optimization.
- Familiarity with MySQL, PostgreSQL, Elasticsearch, or similar databases.