Senior Big Data Engineer

6 days ago


Remote Wrocław, Czech Republic Comscore (via CC) Full time

Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.

We are looking for a skilled Java/Spark Big Data Developer to join our team in Poland.

About the Role

This is an exciting opportunity to work on real big data projects at petabytes scale. As a Senior Big Data Engineer, you will be responsible for designing and implementing high-performance processing pipelines using Java and Spark.

You will work closely with cross-functional teams to integrate different platforms and ensure smooth data flow. Troubleshooting and debugging issues to improve overall system stability will also be a key part of your role.

Responsibilities
  • Design and implement Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance
  • Work with distributed systems, contributing to the design and implementation of backend solutions
  • Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow
  • Troubleshoot and debug issues to improve overall system stability
  • Participate in code reviews and offer guidance on best practices
Requirements
  • Java, Spark, and Big Data expertise
  • Commercial experience with Java and Linux
  • Proven ability to debug JVM/Java and Spark ecosystems
  • Ability to design high-performance processing pipelines
  • Familiarity with CI/CD pipelines and DevOps practices
What We Offer
  • An international team environment
  • A small, independent team working environment
  • Flexible work time
  • Fully remote or in-office work in Wroclaw, Poland
  • Competitive salary and benefits package
  • Professional development opportunities


  • Remote, Czech Republic Adaptiq Full time

    At least 5 years of experience in Data Engineering domainAt least 2 years of experience with GoLangProficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databasesExperienced with big data tools such as Spark or Flink to enhance system performance and scalabilityProven experience with Kubernetes (K8S) and familiarity with GTP tools to ensure...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    We are seeking a seasoned Petabyte-Scale Big Data Engineer to join our team at Comscore (via CC). As a key member of our international team, you will play a vital role in driving projects forward and improving existing systems.About the RoleThe ideal candidate will have extensive experience with petabyte-scale big data pipelines using Scala, Spark,...


  • Remote, Czech Republic SoftServe Full time

    IF YOU ARESpecializing in big data engineering with a focus on data pipeline creationAdept at batch and streaming processingProficient in Python and SQLExperienced in developing data solutions on the AWS cloud platformSkilled in utilizing Apache Spark and DatabricksFamiliar with orchestration tools like Apache Airflow or Managed Apache Airflow...


  • Remote, Czech Republic Big Human Full time

    About the RoleWe are seeking a seasoned Senior Flutter Developer to join our team at Big Human, a digital product studio with a passion for creating innovative online experiences. As a key member of our development team, you will be responsible for designing and delivering high-quality cross-platform mobile applications that exceed user expectations.Key...


  • Remote, Czech Republic SoftServe Full time

    IF YOU AREExperienced with Python and PySparkProficient in Databricks Lakehouse architecture and principlesSkilled in designing data models, building ETL pipelines, and wrangling data to solve business challengesKnowledgeable in Azure cloud technologies, including Azure Data Factory, Azure DevOps, Azure Synapse, and Azure Data Lake ServicesAdvanced in SQL...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Addepto is a leading consulting and technology company specializing in AI and Big Data. Our expertise helps clients deliver innovative data projects, partnering with top-tier global enterprises and pioneering startups.Job OverviewThis role involves working as a Senior Data Engineer on challenging projects across various industries, leveraging cutting-edge...

  • Data Engineer

    5 days ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Job OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We are seeking an experienced Data Engineer - AI & Big Data Specialist to join our team.Key Responsibilities:Design, develop, and maintain high-performance data processing platforms for automotive and aerospace industries.Create scalable and reliable data...


  • Remote, Czech Republic SoftServe Full time

    Job OverviewSoftServe is a global digital solutions company with a strong presence in the data engineering space. As a Senior Big Data Engineer, you will be part of our team that designs and implements cloud-based data pipelines to drive business value.About UsWe are a dynamic organization that fosters a culture of innovation and continuous learning. Our...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...


  • Remote, Kraków, Czech Republic N-iX Full time

    We are seeking a proactive Senior Data Engineer to join our vibrant team at N-iX. In this role, you will collaborate closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry.Key ResponsibilitiesDesign, Implement, and Maintain Scalable Data Pipelines:...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 6 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.Hands-on with Big Data technologies like Spark, Cloudera Data Platform, Airflow,...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    About UsComscore (via CC) is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.We lead in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global...

  • Data Engineer

    7 hours ago


    Gdańsk, Wrocław, Poznań, Kraków, Waszawa, Czech Republic Capgemini Polska Sp. z o.o. Full time

    About Insights & Data:Our team is a dynamic and innovative group of over 400 professionals delivering cutting-edge data solutions. We specialize in Cloud & Big Data engineering, building scalable systems for complex datasets across top cloud providers. Our expertise spans the full Software Development Life Cycle (SDLC), utilizing modern data processing...

  • Senior Data Engineer @

    16 hours ago


    Remote, Warsaw, Kraków, Wrocław, Gdańsk, Czech Republic RemoDevs Full time

    4+ years of experience with Python Proven expertise in Databricks and data pipeline development Strong skills in SQL for data processing and transformation Proficiency with cloud platforms (preferably Azure) Fluent English communication skills Senior Data EngineerAre you passionate about turning raw data into meaningful insights? Do you thrive in a...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have: 2+ years of experience with Linux Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows) 1+ years of experience with Spark,  primarily using Scala for Big data...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows)4+ years of experience with Spark,  primarily using Scala for Big data processing (that includes understanding of how...


  • Remote, Wrocław, Warszawa, Kraków, Poznań, Katowice, Czech Republic DataRiseLab Full time

    Experience:4+ years of experience in Data Engineering Experience in Microsoft Azure Data ecosystem (i.e. Azure Data Factory, Azure SQL and Synapse Analytics, Data Bricks) Experience with data modelling and data integration Knowledge in SQL (T-SQL or any other) Problem-solving, analytical and critical thinking skills Experience with Agile and Scrum...


  • Remote, Czech Republic Link Group Full time

    We are seeking an experienced Senior Teradata Engineer to join our dynamic team at Link Group.This role requires a strong focus on designing, developing, and optimizing large-scale data solutions using Teradata.As a key member of our cross-functional team, you will collaborate closely with stakeholders to ensure data integrity, performance, and scalability...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Very good understanding of Linux internals (processes/threads, service management, resource allocation)Linux as a daily driver of operations1+ years of commercial experience with JavaProven ability to debug JVM/Java (hopefully in Spark ecosystem)Ability to design high performance processing pipelinesHands-on, proactive...