Technical Lead for Big Data Engineering

10 hours ago


Remote Wrocław, Czech Republic Comscore (via CC) Full time

Comscore, a global leader in media analytics, is seeking a skilled Scala/Linux Big Data Developer to join our team in Poland and around the world.

We're looking for someone with expertise in designing, implementing, and maintaining petabyte-scale big data pipelines using Scala, Kubernetes, and other technologies.

The ideal candidate will have a solid understanding of Linux, strong knowledge of HTTP API communication patterns, and excellent software debugging skills.

You'll work closely with our international team to drive projects forward, improve existing systems, and develop new solutions using cutting-edge technology.

Company Overview

At Comscore, we revolutionize insights into consumer behavior, media consumption, and digital engagement. We measure and analyze audiences across diverse digital platforms, working with industry leaders like Facebook, Disney, and Amazon.

We offer a collaborative and dynamic work environment, with opportunities for growth and professional development.

Job Description

This role involves:

  • Designing and implementing scalable big data pipelines using Scala and Kubernetes
  • Optimizing big data processes for improved performance and efficiency
  • Conducting Proof of Concept (PoC) for enhancements and improvements
  • Collaborating with other big data teams to drive projects forward
  • Working with technologies like AWS, Hadoop, Linux/Ubuntu, and Kafka

You'll be responsible for writing high-quality, performant big data Scala code and contributing to the development of innovative solutions.

Requirements
  • Expertise in Scala, Linux, and big data technologies
  • Strong knowledge of HTTP API communication patterns
  • Excellent software debugging skills
  • Ability to work independently and collaboratively as part of a team
  • Familiarity with Agile and Kanban methodologies
Benefits

We offer a range of benefits, including:

  • A competitive salary package
  • Flexible work time and fully remote or in-office work arrangements
  • A comprehensive health insurance plan
  • A multikafeteria program
  • Free parking and private healthcare

We're committed to creating a positive and inclusive work environment, where everyone can thrive and grow professionally.



  • Remote, Czech Republic ALM Services Technology Group Full time

    We are currently seeking resources with experience in building and taking to production low latency, Massive Parallel Processing (MPP) data and analytic systems, ideally on Hadoop, Scala and Spark. The Candidate that meets the following criteria:∙Computer Science Degree/Student ∙3+ years strong native SQL skills ∙3+ years strong experience in...


  • Remote, Kraków, Wrocław, Warszawa, Czech Republic N-iX Full time

    Must have:Python Development: Minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.Ingestion and modelling:Experience with Python and orchestration tools like Airflow is beneficial.SQL Proficiency: Advanced knowledge of SQL:At least one of PostgreSQL, MySQL, MSSQLAbility to write complex...

  • Big Data Engineer

    15 hours ago


    Remote, Czech Republic Link Group Full time

    Must-Have QualificationsAt least 3+ years of experience in big data engineering.Proficiency in Scala and experience with Apache Spark.Strong understanding of distributed data processing and frameworks like Hadoop.Experience with message brokers like Kafka.Hands-on experience with SQL/NoSQL databases.Familiarity with version control tools like Git.Solid...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:2+ years of experience with LinuxSolid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows)Huge need to drive projects of the future, improve stuff, risk taking mindset - covered...


  • Remote, Czech Republic SoftServe Full time

    IF YOU AREExperienced with Python and PySparkProficient in Databricks Lakehouse architecture and principlesSkilled in designing data models, building ETL pipelines, and wrangling data to solve business challengesKnowledgeable in Azure cloud technologies, including Azure Data Factory, Azure DevOps, Azure Synapse, and Azure Data Lake ServicesAdvanced in SQL...


  • Remote, Czech Republic Link Group Full time

    We are currently seeking a Strategic Data Engineering Lead with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.About the RoleThe ideal candidate will have experience in designing, implementing, and optimizing big data processing pipelines using Scala and Spark. They will work with massive...


  • Remote, Czech Republic ALM Services Technology Group Full time

    We are seeking a highly experienced Data Engineer to lead our team in building a next-generation Global Data Lake and Analytics platform.This role involves designing and delivering data models, which power business intelligence initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases. You will work closely with data architects on...

  • Technical Lead

    2 days ago


    Remote, Czech Republic Skytek Full time

    Minimum BSc in Computer Science (or equivalent).Minimum 5 years of experience in web application development with a strong background in Django and Python.Proven experience leading technical projects and teams.Strong proficiency in building and maintaining REST APIs.Extensive experience with relational databases, specifically PostgreSQL.Familiarity with...


  • Remote, Czech Republic Link Group Full time

    7+ years of experience in data engineering, including 2+ years in a leadership or architecture role.Expertise in Airflow, Snowflake, DBT, and advanced knowledge of Python, Spark, SQL, and AWS.Proven experience in designing and deploying large-scale data warehouses and building complex data models.Hands-on experience with third-party APIs and external data...

  • Lead Data Scientist

    18 hours ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:6+ years of commercial experience in designing and implementing scalable AI solutions (Machine Learning, Predictive Modeling, Optimization, NLP, Computer Vision, GenAI).Experience in Machine Learning projects leadership and team mentoring.Proficiency in developing ML algorithms from scratch to production...


  • Remote, Bydgoszcz, Czech Republic Inhabit Polska Full time

    At Inhabit Polska, we are seeking an exceptional Technical Lead and Software Engineering Manager to lead our engineering team in delivering high-quality software solutions.About the RoleWe are looking for a seasoned technical leader with a passion for technology and leadership. As a Technical Lead and Software Engineering Manager, you will be responsible for...


  • Remote, Czech Republic Link Group Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our team at Link Group. This is a unique opportunity to lead and mentor a team of data engineers while actively contributing to pipeline development, architecture design, and system optimization.Key ResponsibilitiesDesign and implement scalable, high-performance data architectures that...


  • Remote, Czech Republic Matrix Global Services Full time

    Job DescriptionWe are seeking a highly skilled Lead Data Engineer to join our team at Matrix Global Services.About the RoleThe successful candidate will lead development projects of critical, high-availability cloud-scale services and APIs. They will support clients with large amounts of data and scalability in mind.Key Responsibilities:Leverage expertise in...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    Job DescriptionWe are seeking a highly skilled Linux Systems Engineer to join our team at Comscore (via CC). As a key member of our technical staff, you will be responsible for designing and implementing scalable cloud infrastructure solutions using AWS. Your expertise in Linux internals, programming languages, and DevOps practices will enable us to deliver...


  • Remote, Kraków, Wrocław, Warszawa, Czech Republic N-iX Full time

    Job OverviewWe are seeking a highly skilled Technical Lead Data Engineer to join our team in London and lead the development of our internal Data Platform.About UsN-iX is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of our portfolio companies. Our key objectives include...

  • Lead ML Engineer @

    3 days ago


    Remote, Warsaw, Czech Republic hubQuest Full time

    Advanced degree in computer science, statistics, or a related STEM field.At least 5 years of ML engineering (or engineering support for data science) experience in an industrial/commercial setting.Deep knowledge of ML algorithms and data science concepts.Experience with ML frameworks such as TensorFlow, PyTorch, and MLflow.Strong Python software...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    About AddeptoAddepto is a cutting-edge consulting and technology company specializing in AI and Big Data. We partner with top-tier global enterprises and pioneering startups to deliver innovative data projects.Exciting Project OpportunitiesDesign and Development of Azure Data Platform: Migrate SSAS cube objects and SSIS pipelines from on-premises SQL Server...


  • Remote, Kraków, Czech Republic N-iX Full time

    Company OverviewN-iX is a leading IT services company that provides innovative solutions to businesses across various industries.Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining sophisticated data pipelines in Palantir Foundry.Required Skills and...


  • Remote, Lisbon, Frankfurtammain, Heidelberg, Warszawa, Czech Republic Data Science UA Full time

    About Data Science UA:">We are a service company with strong data science and AI expertise, fostering the largest Data Science Community in Eastern Europe.About Our Client:">The company is a market-leading intelligence platform for paid search advertising, leveraging artificial search intelligence and industry knowledge to drive value from PPC budgets.About...


  • Remote, Kraków, Czech Republic N-iX Full time

    4+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industryProven experience as a Data Engineer with a focus on cloud-based solutions.Strong proficiency in Python, and PySparkHands-on experience with Azure cloud servicesExpertise in data modeling, database design, and optimization.Familiarity with Big Data...