Data Engineer

Job Overview: We are seeking a talented and motivated Senior Data Engineer with expertise in Scala and Python to join our data engineering team. This individual will play a key role in the design, development, and optimization of our data infrastructure and data pipelines. The ideal candidate has a passion for building scalable, high-performance systems and is eager to broaden their knowledge across the entire data engineering stack, from hardware infrastructure to project development. Key responsibilities: • Collaborate with cross-functional teams to design, develop, and maintain data engineering solutions using Scala, Python, and Apache Spark. • Implementation of new data engineering technologies, frameworks, and tools, such as HDFS, MongoDB, and PostgreSQL, to enhance performance, scalability, and efficiency. • Understand and optimize hardware and resource consumption for data engineering projects. • Develop a deep understanding of hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage. • Design and architect high-performance, fault-tolerant, and scalable data pipelines. • Conduct research and stay current with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms. • Mentor and guide junior team members, fostering a culture of continuous learning and skill development. • Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects. Requirements: • 2-3 years of professional experience as a Software Engineer, with a focus on data engineering. • Keen interest in hardware infrastructure, resource consumption optimization, and data engineering project development. • Proven ability to work effectively in an Agile development environment and manage multiple priorities. • Strong problem-solving, analytical thinking, communication, and collaboration skills.