Scala/Spark Big Data Developer @

6 days ago


Remote Wrocław, Czech Republic Comscore (via CC) Full time

The candidate must have:

  • 2+ years of experience with Linux 
  • Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows) 
  • 1+ years of experience with Spark,  primarily using Scala for Big data processing (that includes understanding of how Spark works and why) 
  • Huge need to drive projects of the future, improve stuff, risk taking mindset - covered by examples 
  • Great communication skills (you can drive end-to-end projects, and guide dev team members) 
  • Professional working proficiency in English (both oral and written) 
  • Understanding of HTTP API communication patterns (HTTP/REST/RPC) and protocol 
  • Good software debugging skills, not only prints, but also using debugger
     
  • Deep understanding of at least one technical area (please let us know which one is this and prepare a story of the biggest battle story about this you had) 
  • Quite good understanding of Git 

Correct Context is looking for a Scala/Spark Big Data Developer for Comscore in Poland and around.

Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.

Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.

We offer:

  • Real big data projects - petabyte scale/thousands of servers / billion of events
  • An international team (US/PL/IE/IN/CL/NL) - slack+zoom+english is standard set
  • Hands-on experience - you have the power to execute your ideas and improve stuff
  • Quite a lot of autonomy in how to execute things
  • A small, independent teams' working environment
  • Flexible work time
  • Fully remote or in-office work in Wroclaw, Poland
  • 14,000 to 20,000 PLN net/month B2B (optional other forms)
  • Private healthcare
  • Multikafeteria / Multisport
  • Free parking

If you don't have all the qualifications, but you're interested in what we do and you have a solid Linux understanding -> let's talk

The recruitment process for the Scala/Spark Big Data Developer  position has following steps:

  1. Technical survey - 10min
  2. Technical screening - 30 min
  3. Technical interview - 60min video call
  4. Technical/Managerial interview- 60min video call
  5. Final Interview - Technical/Managerial - 30min video call
,[Design, implement, and maintain petabyte-scale Big data pipelines using Scala, Spark, Kubernetes and a lot of other tech, Optimize – working with Big data is very specific, sometimes it's IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costly , Conduct Proof of Concept (PoC) for enhancements , Writing great and performant Big Data Scala code, Cooperate with other Big data teams , Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark , Use Slack and Zoom for communication ] Requirements: Scala, Spark, Linux, API, AWS Tools: Jira, Bitbucket, GIT, Jenkins. Additionally: Sport Subscription, Private healthcare, Remote work, Flexible working hours, Free coffee, Playroom, Modern office, No dress code, In-house trainings.

  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    Comscore, a global leader in media analytics, is looking for an experienced Scala Developer to join their team. As a Scala Developer at Comscore, you will play a vital role in designing and developing solutions that process petabytes of data.Company OverviewWe are a trusted partner delivering accurate data to global businesses, working with industry leaders...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Very good understanding of Linux internals (processes/threads, service management, resource allocation)Linux as a daily driver of operations1+ years of commercial experience with JavaProven ability to debug JVM/Java (hopefully in Spark ecosystem)Ability to design high performance processing pipelinesHands-on, proactive...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Very good understanding of Linux internals (processes/threads, service management, resource allocation)Linux as a daily driver of operationsGood understanding of Spark internals and mechanicsKnowledge of Iceberg4+ years of commercial experience with JavaProven ability to debug JVM/Java (hopefully in Spark ecosystem)Ability to design...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    We are seeking a seasoned Petabyte-Scale Big Data Engineer to join our team at Comscore (via CC). As a key member of our international team, you will play a vital role in driving projects forward and improving existing systems.About the RoleThe ideal candidate will have extensive experience with petabyte-scale big data pipelines using Scala, Spark,...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The ideal candidate will have:1+ years of Scala experienceHands-on, proactive approachGood git understandingExperience working with RESTful APIs and service based architectureLinux is your daily driverStrong knowledge of Linux processes, thread management, shell scripting, service management and networkingKnowledge of Spark is highly desirable.Knowledge of...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We help clients deliver innovative data projects by partnering with top-tier global enterprises and pioneering startups.Job DescriptionWe are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will design and develop...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    About ComscoreComscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. We lead in measuring and analyzing audiences across diverse digital platforms.We thrive on using cutting-edge technology to deliver accurate data to global businesses, collaborating with industry leaders...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.We are looking for a skilled Java/Spark Big Data Developer to join our team in Poland.About the RoleThis is an exciting opportunity to work on real big data projects at petabytes scale. As a Senior Big Data Engineer, you...

  • Data Engineer

    4 days ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Job OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We are seeking an experienced Data Engineer - AI & Big Data Specialist to join our team.Key Responsibilities:Design, develop, and maintain high-performance data processing platforms for automotive and aerospace industries.Create scalable and reliable data...


  • Remote, Czech Republic Big Human Full time

    About the RoleWe are seeking a seasoned Senior Flutter Developer to join our team at Big Human, a digital product studio with a passion for creating innovative online experiences. As a key member of our development team, you will be responsible for designing and delivering high-quality cross-platform mobile applications that exceed user expectations.Key...


  • Remote, Czech Republic Adaptiq Full time

    At least 5 years of experience in Data Engineering domainAt least 2 years of experience with GoLangProficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databasesExperienced with big data tools such as Spark or Flink to enhance system performance and scalabilityProven experience with Kubernetes (K8S) and familiarity with GTP tools to ensure...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 6 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.Hands-on with Big Data technologies like Spark, Cloudera Data Platform, Airflow,...

  • Data Engineer @

    4 days ago


    Remote, Kraków, Czech Republic Avenga Full time

    Java/Scala experience,Extensive experience with SQL and Spark/Flink,Ability to write clean, testable, and maintainable code and adherence to best coding practices,Product-minded approach, with a strong willingness to understand the product and its impact. We are looking for Data Engineer with experience in Java or Scala projects to join our team and help us...


  • Remote, Gdziekolwiek, Czech Republic SoftwareMill Full time

    We are a dynamic software house offering innovative solutions to clients worldwide.About UsOur team is comprised of passionate developers dedicated to delivering exceptional results in a flat, agile environment.Job DescriptionA talented Scala Developer will be responsible for designing and implementing scalable software solutions using Akka, Kafka,...


  • Remote, Czech Republic SoftServe Full time

    IF YOU ARESpecializing in big data engineering with a focus on data pipeline creationAdept at batch and streaming processingProficient in Python and SQLExperienced in developing data solutions on the AWS cloud platformSkilled in utilizing Apache Spark and DatabricksFamiliar with orchestration tools like Apache Airflow or Managed Apache Airflow...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU.We have earned recognition by Forbes as one of the top 10 AI companies due to...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups.Job DescriptionDesign and development of a universal data platform for global aerospace companies.Data Platform Transformation for energy...


  • Remote, Czech Republic SoftServe Full time

    Job OverviewSoftServe is a global digital solutions company with a strong presence in the data engineering space. As a Senior Big Data Engineer, you will be part of our team that designs and implements cloud-based data pipelines to drive business value.About UsWe are a dynamic organization that fosters a culture of innovation and continuous learning. Our...


  • Remote, Gdziekolwiek, Czech Republic SoftwareMill Full time

    Must have:Team playerAbility to work independentyCommunication skillsProactivityClean and testable codeSoftware Architecture patternsScalability patterns4+ years of commercial experienceNice to have:Personal blog2nd JVM languageConference / meetup speakerOpen-source contributorPet-project We are a small, flat, agile, but still growing software house full of...


  • Remote, Kraków, Czech Republic ICEO Venture Builder Full time

    What we expect from you:Over 4 years of experience in backend development.Extensive proficiency in Scala with a minimum of 3 years of commercial experience.Minimum 1 year of commercial experience in functional programming and Scala Zio stack.Considerable expertise and proven track record of successfully designing and building web systems based on...