Big Data Developer for Cutting-Edge Analytics

4 days ago


Remote Wrocław, Czech Republic Comscore (via CC) Full time

About Us

Comscore (via CC) is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.

We lead in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon.

Job Description

We are looking for an experienced Scala/Spark Big Data Developer to join our team in Poland and around the world.

As a key member of our big data team, you will design, implement, and maintain petabyte-scale big data pipelines using Scala, Spark, Kubernetes, and other technologies.

You will optimize these pipelines to ensure they are efficient and performant, working with big data is very specific, sometimes it's IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things.

At least empirical knowledge of calculation complexity, as in big data, even simple operations, when you multiply by the size of the dataset can be costly.

Responsibilities

  1. Design, implement, and maintain petabyte-scale big data pipelines using Scala, Spark, Kubernetes, and other technologies.
  2. Optimize these pipelines to ensure they are efficient and performant.
  3. Conduct Proof of Concept (PoC) for enhancements.
  4. Write great and performant big data Scala code.
  5. Collaborate with other big data teams.
  6. Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark.
  7. Use Slack and Zoom for communication.

Requirements

  • Scala, Spark, Linux, API, AWS
  • Jira, Bitbucket, GIT, Jenkins

Benefits

  • Petabyte-scale big data projects
  • An international team with flexible work arrangements
  • Hands-on experience with real-world applications
  • A small, independent team environment
  • Flexible work hours and remote work options
  • Competitive salary and benefits package


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects.


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows)4+ years of experience with Spark,  primarily using Scala for Big data processing (that includes understanding of how...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We help clients deliver innovative data projects by partnering with top-tier global enterprises and pioneering startups.Job DescriptionWe are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will design and develop...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a pioneering consulting and technology company specializing in AI and Big Data, helping clients deliver cutting-edge data projects. We partner with top-tier global enterprises and innovative startups, leveraging our expertise to drive business growth.


  • Remote, Czech Republic Devire Full time

    Minimum 3-5 years of professional experienceFluency in English3-5 years of relevant experience in Spark/ScalaStrong expertise in Hadoop ecosystem (Spark, Scala, Hive, HDFS, SQOOP, Oozie, Hadoop)Basic knowledge of Jenkins, GIT, Python/Java, and SQLStrong problem-solving and analytical mindsetExcellent written and verbal communication skillsTeam player with...

  • Data Engineer

    4 days ago


    Gdańsk, Wrocław, Poznań, Kraków, Waszawa, Czech Republic Capgemini Polska Sp. z o.o. Full time

    About Insights & Data:Our team is a dynamic and innovative group of over 400 professionals delivering cutting-edge data solutions. We specialize in Cloud & Big Data engineering, building scalable systems for complex datasets across top cloud providers. Our expertise spans the full Software Development Life Cycle (SDLC), utilizing modern data processing...


  • Remote, Warszawa, Czech Republic AUTO1 Polska Sp.z o.o. Full time

    We are seeking a technically skilled PHP Engineer located in Poland to join our dynamic Software Engineering department at AUTO1 Group Technology. Our team leverages cutting-edge technology to gather and analyze data, optimizing our platforms and processes.Company OverviewAUTO1 Group is Europe's leading digital automotive platform. We revolutionize the used...


  • Remote, Czech Republic SoftServe Full time

    Company OverviewSoftServe is a global digital solutions company that empowers clients to succeed in an increasingly complex digital world. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM.Job DescriptionWe are seeking a highly skilled Data Engineering Expert to join our Big Data & Analytics Center of Excellence....


  • Remote, Czech Republic SoftServe Full time

    IF YOU AREExperienced with Python and PySparkProficient in Databricks Lakehouse architecture and principlesSkilled in designing data models, building ETL pipelines, and wrangling data to solve business challengesKnowledgeable in Azure cloud technologies, including Azure Data Factory, Azure DevOps, Azure Synapse, and Azure Data Lake ServicesAdvanced in SQL...


  • Remote, Warsaw, Czech Republic GetInData | Part of Xebia Full time

    At GetInData, we are committed to delivering innovative data-driven solutions that drive business value. As a Senior Data Scientist, you will play a pivotal role in our team by leveraging your expertise in machine learning and advanced analytics to address complex business challenges.ResponsibilitiesData Solution Development: Design and implement...


  • Remote, Warszawa, Czech Republic Evertz Full time

    Job Description:We are seeking an experienced Embedded Software Engineer to join our team at Evertz. As an Embedded Software Engineer, you will be responsible for designing and developing software for embedded systems.About the Role:This is a fantastic opportunity for a talented engineer to work on cutting-edge projects and contribute to the development of...


  • Remote, Czech Republic ALM Services Technology Group Full time

    We are currently seeking resources with experience in building and taking to production low latency, Massive Parallel Processing (MPP) data and analytic systems, ideally on Hadoop, Scala and Spark. The Candidate that meets the following criteria:∙Computer Science Degree/Student ∙3+ years strong native SQL skills ∙3+ years strong experience in...


  • Remote, Czech Republic PAR Data Central Full time

    OverviewPAR Data Central is a leading provider of restaurant technology solutions. We operate at the forefront of innovation, leveraging cutting-edge technologies to enhance our platform's capabilities.About the RoleWe are seeking an experienced AI/ML Engineer to join our Data Central software development team. As an AI/ML Engineer, you will play a crucial...


  • Remote, Warsaw, Czech Republic hubQuest Full time

    Company OverviewWe are a team of experts at hubQuest, bringing together top talents in IT and analytics. Our mission is to provide cutting-edge solutions through our flagship services: building tech teams from scratch and expanding existing units, all to help our partners become truly data-driven organizations.About the MissionWe emphasize collaboration,...


  • Remote, Czech Republic scandiweb Full time

    At least 2-5 years of experience in a senior role focusing on data analytics and business development;Strong background in using analytics to drive sales strategies in eCommerce or similar industries;Proficiency in major analytics and business intelligence platforms (Google Analytics, Tableau, GTM, CDPs);Easily navigate across all available platforms, tools,...


  • Gdańsk, Wrocław, Poznań, Kraków, Waszawa, Czech Republic Capgemini Polska Sp. z o.o. Full time

    About Insights & Data:Insights & Data is a dynamic team of over 400 professionals delivering cutting-edge data solutions. We specialize in Cloud & Big Data engineering, building scalable systems for complex datasets across AWS, Azure, and GCP. Our expertise spans the full Software Development Life Cycle (SDLC), utilizing modern data processing tools,...

  • Data Engineer

    4 days ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 4 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.Hands-on with Big Data technologies like Spark, Cloudera Data Platform, Airflow,...


  • Remote, Kraków, Czech Republic Kontakt Full time

    Transforming Care Delivery OperationsKontakt.io is revolutionizing the way care operations are managed, leveraging AI and data analytics to optimize resource utilization and patient outcomes.Job SummaryWe are seeking a skilled Data Platform Engineer to design, build, and maintain scalable, high-performance data infrastructure.The ideal candidate will have...


  • Remote, Warszawa, Cracow, Wrocław, Czech Republic N-iX Full time

    We are seeking a seasoned Senior Cloud Data Solutions Architect to join our team at N-iX.Company OverviewN-iX is a software development and consulting company that empowers businesses to thrive in the digital world. We excel in delivering cutting-edge solutions across various industries, from finance and healthcare to education and beyond.SalaryOur...

  • Senior Data Analyst

    5 days ago


    Remote, Warsaw, Czech Republic hubQuest Full time

    5+ years of experience in data analysis or a related field, with a proven track record of leading analytical projects.Advanced proficiency in Power BI (must-have) and SQL.Strong knowledge of Python for data analysis and automation.A degree (Bachelor's or Master's) in Statistics, Mathematics, Computer Science, Economics, or another quantitative field.At...