Senior Data Engineer

🚀 Senior Data Engineer - Mindera At Mindera, we leverage technology to build high-impact products that transform businesses. Our Data Engineering team plays a crucial role in enabling data-driven decisions by building scalable, reliable, and efficient data platforms. As a Senior Data Engineer, you will work on designing and building robust data solutions that power analytics, machine learning, and real-time data applications. You'll collaborate closely with cross-functional teams including Data Scientists, Machine Learning Engineers, and Product teams to deliver high-quality data products. Requirements 🔧 What You'll Do Design, build, and maintain scalable data pipelines and data models to support analytics and machine learning use cases Develop and optimize data platforms for both batch and real-time data processing Work with large-scale datasets to transform raw data into meaningful, high-quality datasets Build and manage cloud-native data solutions (primarily on AWS or similar platforms) Implement best practices for data quality, monitoring, and reliability Contribute to CI/CD pipelines to automate testing, deployment, and data workflows Collaborate with cross-functional teams to enable self-service analytics and data-driven decision-making Work closely with ML teams to support feature engineering, model pipelines, and embedding workflows 🧠 What We're Looking For Strong hands-on experience in Python and SQL Proven experience in building data pipelines for analytics and ML workloads Strong understanding of data modelling, data warehousing, and data lakes Hands-on experience with tools like Spark, Airflow, DBT, or similar Experience working with cloud platforms (AWS preferred) Familiarity with modern data formats such as Parquet, Iceberg Experience with both batch and real-time data processing Knowledge of CI/CD practices (Jenkins, GitHub Actions) Experience with Infrastructure as Code (Terraform) and containerization (Docker) Strong problem-solving skills and ability to work in a fast-paced, collaborative environment Understanding of Vector Databases (e.g., Pinecone, Weaviate, or similar) Familiarity with Embeddings (text/image embeddings, semantic search use cases) Basic to intermediate knowledge of Machine Learning concepts and pipelines 🌟 Nice to Have Experience working with feature stores and ML pipelines Exposure to streaming technologies (Kafka, Kinesis, etc.) Understanding of data governance and data quality frameworks Experience with LLM-based applications or semantic search systems Benefits We offer Flexible working hours (self-managed) Competitive salary Annual bonus, subject to company performance Access to Udemy online training and opportunities to learn and grow within the role At Mindera we use technology to build products we are proud of, with people we love. Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera. We partner with our clients, to understand their products and deliver high-performance, resilient and scalable software systems that create an impact on their users and businesses across the world. You get to work with a bunch of great people, and the whole team owns the project together. Our culture reflects our lean and self-organisation attitude. We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication. We are proud of our work and we love to learn all and everything while navigating through an Agile, Lean and collaborative environment. Check out our Blog: http://mindera.com/ and our Handbook: http://bit.ly/MinderaHandbook Our offices are located: Porto, Portugal | Aveiro, Portugal | Coimbra, Portugal | Leicester, UK | San Diego, USA | Chennai, India | Bengaluru, India