Data Engineering Lead for Big Data Processing

4 hours ago


Remote, Czech Republic Link Group Full time
Overview

At Link Group, we are seeking an exceptional Data Engineering Lead to lead our efforts in big data processing.

This role will be instrumental in designing and implementing scalable data pipelines that drive business growth.

Key Responsibilities:
  • Develop high-quality, production-ready Python code with a focus on PySpark for big data processing.
  • Build and maintain scalable data pipelines, automating workflows for efficiency and reliability.
  • Leverage Docker & Kubernetes to containerize and orchestrate applications in a cloud environment.
  • Ensure best coding practices, implementing automated testing to maintain robust and error-free deployments.
Requirements:
  • Proficiency in Python and PySpark.
  • Hands-on experience with containerization (Docker, Kubernetes).
  • Solid understanding of big data processing and how to handle large datasets efficiently.
  • Experience in automation—from CI/CD pipelines to test automation.
  • Knowledge of coding best practices.
Preferred Skills:
  • Experience with cloud platforms (AWS, GCP, Azure).
  • Exposure to orchestration tools like Apache Airflow.
  • Familiarity with streaming data technologies (Kafka, Spark Streaming).
Benefits:

We offer a dynamic work environment that fosters collaboration and innovation.

What We Offer:
  • A competitive salary package.
  • Ongoing training and professional development opportunities.
  • A collaborative and inclusive team culture.


  • Remote, Czech Republic Link Group Full time

    Job Description:At Link Group, we are seeking a highly skilled Senior Big Data Engineer to join our team.About the Role:We are looking for an experienced engineer with strong expertise in Python and PySpark in a production environment. The ideal candidate will have hands-on experience in containerization (Docker, Kubernetes) and solid understanding of big...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    About ComscoreComscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Our company leads in measuring and analyzing audiences across diverse digital platforms.We thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global...


  • Remote, Wrocław, Czech Republic Data Hiro sp. z o.o. Full time

    About UsData Hiro sp. z o.o. is a company passionate about turning business data visions into reality.We are currently seeking a skilled DevOps specialist to join our team and work closely with our major client, the Vienna City Council.Our WorkData Hiro plays a crucial role in the digitalization of Vienna's public services by providing essential database...

  • Big Data Architect

    4 hours ago


    Remote, Warsaw, Czech Republic GetInData | Part of Xebia Full time

    We are seeking a skilled Big Data Architect to design and implement scalable data solutions.About the Role:Data Engineering Expertise: Proficiency in programming languages such as Python and Scala, with hands-on experience in Spark messaging systems, Hadoop, and Kubernetes.Strong Programming Skills: Solid understanding of software engineering principles,...


  • Remote, Wrocław, Czech Republic Data Hiro sp. z o.o. Full time

    Company OverviewData Hiro sp. z o.o. is a leading provider of data solutions for public services. Our team is passionate about turning business data vision into reality.Job DescriptionWe are seeking an experienced DevOps engineer to join our team. The successful candidate will have the opportunity to work closely with our major client, the Vienna City...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    Comscore (via CC) is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.The company measures and analyzes audiences across diverse digital platforms, delivering accurate data to global businesses and collaborating with industry leaders like Facebook, Disney, and Amazon.As a trusted...


  • Remote, Kraków, Czech Republic Appliscale Full time

    Our client is a leading game studio behind successful MOBA and FPS franchises.We are building a Data Team accountable for decision science, data products, data capture, and data warehousing and governance. Our mission is to harness the power of data for player-centric decisions and AI/ML products that enhance the gaming experience.As a core contributor, you...

  • Data Architect

    4 hours ago


    Remote, Czech Republic Speechify Full time

    Company OverviewSpeechify is the leading platform for audio information, aiming to revolutionize the way we consume and interact with content. Our mission is to make learning easier, deeper, and faster by providing a seamless listening experience.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our Data Acquisition team at Speechify....


  • Remote, Wroclaw, Wrocław, Czech Republic Comscore (via CC) Full time

    Job DescriptionComscore (via CC) is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.We are seeking an experienced Data Ingestion Technical Product Owner to join our team in Poland. As a key member of our organization, you will play a vital role in leading the development and...


  • Remote, Wrocław, Gdańsk, Rzeszów, Czech Republic Xebia sp. z o.o. Full time

    We are a pioneering technology company, Xebia sp. z o.o., driven by innovation and excellence. Our mission is to establish ourselves as authorities in our field of expertise.As a Senior AWS Data Engineer at Xebia, you will play a pivotal role in designing, building, and deploying large-scale data processing systems using cloud technologies. Your focus will...


  • Remote, Kraków, Czech Republic Kontakt Full time

    At Kontakt.io, we are building a revolutionary platform that transforms care operations. As a Data Platform Engineer, you will play a vital role in designing and maintaining scalable data infrastructure to support real-time analytics, data ingestion, and machine learning applications.The ideal candidate has 5+ years of experience as a Data Engineer or...


  • Remote, Warszawa, Czech Republic Devire Full time

    Company OverviewDevire IT Outsourcing is a dynamic and innovative company dedicated to providing top-notch IT services. Based on the principles of own business - B2B, we implement projects for clients running innovative and modern projects.Job DescriptionWe are looking for a highly skilled Lead Data Transformation Specialist who will join our team working on...


  • Remote, Gdańsk, Czech Republic Netminds Full time

    We are seeking an experienced Business Intelligence (BI) Engineer to join our data team in creating a world-class software solution. Our mission is to build an innovative cloud data platform for the retail industry, transforming the shopping experience with data-driven solutions on a large scale using Azure stack.The successful candidate will be responsible...


  • Remote, Warsaw, Czech Republic GetInData | Part of Xebia Full time

    Job DescriptionCraft the backbone of our organization's data infrastructure as a Data Platform Architect.Key ResponsibilitiesDesign and implement scalable data platforms using provided infrastructure, ensuring seamless integration with Analytics Engineers' workflows.Collaborate with Platform Engineers to select suitable technologies and tools for projects,...


  • Remote, Warsaw, Warszawa, Czech Republic Sunscrapers Full time

    About SunscrapersSunscrapers is a leading force in software development, dedicated to helping clients grow and innovate through a comprehensive tech stack and robust data-related projects.We are expanding our presence in a data-centric environment and invite you to join our mission as a Senior Data Engineer.Job DescriptionAs a Senior Data Engineer at...


  • Remote, Kraków, Czech Republic Altimetrik Poland Full time

    Altimetrik Poland is a cutting-edge digital enablement company, renowned for delivering agile and innovative solutions to businesses worldwide.We are seeking an exceptional Senior Data Engineer to join our dynamic team. As a key member of our organization, you will be responsible for designing, implementing, and maintaining data pipelines that drive business...


  • Remote, Kraków, Czech Republic Ocado Technology Full time

    **Company Overview**Ocado Technology is a company that prioritizes security and innovation in data handling.**Job Description**As our Lead ETL Data Security Specialist, you will oversee the delivery of ETL pipelines while ensuring compliance with security and data governance requirements. This role involves maintaining high timeliness, quality, and security...


  • Remote, Czech Republic emagine Sp. Z o.o. Full time

    **About the Role**We are seeking a highly skilled Data Engineering Leader to join our team at emagine Sp. Z o.o.You will be responsible for designing, building, and maintaining data platforms and pipelines, as well as mentoring new engineers.As a Senior Data Engineer, you will work closely with engineering, product, and data teams to deliver scalable and...


  • Remote, Czech Republic UPTARGET Full time

    UPTARGET is seeking a seasoned Data Engineer to lead the management and optimization of data infrastructure for an e-commerce project.Key Responsibilities:- Develop and implement data infrastructure solutions using Azure Data Warehouse and Qlik (or similar platforms).- Design and optimize ETL/ELT processes to ensure data accuracy and efficiency.- Collaborate...


  • Remote, Wrocław, Gdańsk, Rzeszów, Czech Republic Xebia sp. z o.o. Full time

    About XebiaXebia is a global company that specializes in developing digital solutions for clients across various industries.Our expertise lies in cloud-based solutions, and we have partnerships with top cloud providers like Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP).Job DescriptionAs a highly skilled Data Engineer, you will...