Data Engineer @ Tesco Technology

This job requires to be based in/close to Kraków. We currently work in a hybrid model and meet in our office 3 days a week. Qualifications Mandatory skills:  Data Processing: Apache Spark - Scala or Python Data Storage: Apache HDFS or respective cloud alternative Resource Manager: Apache Yarn or respective cloud alternative Lakehouse: Apache Hive/Kyuubi or alternative Workflow Scheduler: Airflow or alternative Nice to have skills: Functional programming Apache Kafka Kubernetes Stream processing CI/CD Unsure if you fit all the criteria? Apply and give us the chance to evaluate your potential – you could be the perfect fit Job Description The Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities, including: Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency. Managing critical data related to customer orders, suppliers, and products to ensure the seamless flow of our fulfillment operations. Upholding data integrity and security during the processing of order and delivery-related information. In this role, you will take charge of expanding and refining our data and data pipeline architecture. Additionally, you will be instrumental in optimizing data flow and collection to cater to the needs of cross-functional teams. This role calls for a high level of self-direction and the ability to effectively support the data requirements of multiple teams, systems, and products. Company Description Tesco is a leading multinational retailer, with more than 330 000 colleagues. Our software is used by millions of people across several countries every day. Whether it’s the tills and websites our customers use, or the systems our colleagues and partners use, you’ll play your part in keeping it running like a well-oiled machine. And when a business problem pops up? You and the creative minds in our team will be challenged to solve it. As Tech Hub we cooperate within the group of Tesco Technology Hubs located in the UK, Poland, Hungary, and India. What our colleagues like the most at Tesco: We develop our own products We make an impact; large scale of operation Accountability and respect are given to us We cooperate and support each other There are great colleagues who are divided into small teams here We can develop and learn new things Additional Information Hybrid workingWe know life looks a little different for each of us. That’s why at Tesco, we always welcome chats about different flexible working options. Some people are at the start of their careers, some want the freedom to do the things they love. Others are going through life-changing moments like becoming a carer, adapting to parenthood, or something else. So, talk to us throughout your application about how we can support. This role requires you to be based in or near Kraków, as you will spend 60% (3 days) of your week collaborating with colleagues at our office locations or local sites and the rest remotely. Benefits Tesco is a diverse and exciting employer, dedicated to being #aplacetogeton, providing career-defining opportunities to all of our colleagues. If you choose to join our business, we will provide you with (for all): Permanent contract from the go – as a sign of our trust in your abilities MacBook as your tool for work Learning opportunities - certified technical training and learning platforms like Udemy Referral Bonus Sports activities with a personal trainer in the office Benefits for colleagues on employment of contract only: Additional 4 days of paid leave to support your well-being and family life Up to 20% yearly salary bonus – based on both individual and business performance Private healthcare (LuxMed) Cafeteria & Multisport Supporting those, who are not yet eligible for full holiday entitlement, by expanding their pool from 20 to 25 days Relocation Help IP Tax Deductible Costs If that sounds exciting, then we'd love to hear from you. Tesco is committed to celebrating diversity and everyone is welcome at Tesco. As a Disability Confident Employer, we’re committed to providing a fully inclusive and accessible recruitment process, allowing candidates the opportunity to thrive and inform us of any reasonable adjustments they may require. ,[Create and maintain optimal data pipeline architecture, Assemble large complex data sets that meet functional / non-functional business requirements., Identify design and implement internal process improvements: automating manual processes optimising data delivery re-designing infrastructure for greater scalability etc., Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources, Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition operational efficiency and other key business performance metrics., Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs., Keep our data separated and secure, Create data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader., Work with data and analytics experts to strive for greater functionality in our data systems.] Requirements: Hadoop, Scala, Kafka, Kubernetes, Spark, Spark Streaming, Hive, Functional programming Additionally: International projects, Private healthcare, Small teams, Sport subscription, Free coffee, Canteen, Bike parking, Playroom, Mobile phone, Free parking, Modern office, No dress code, Shower.