Big Data Engineer

22 hours ago

Remote, Czech Republic Link Group Full time
Must-Have Qualifications
  • At least 3+ years of experience in big data engineering.
  • Proficiency in Scala and experience with Apache Spark.
  • Strong understanding of distributed data processing and frameworks like Hadoop.
  • Experience with message brokers like Kafka.
  • Hands-on experience with SQL/NoSQL databases.
  • Familiarity with version control tools like Git.
  • Solid understanding of data architecture and ETL processes.
  • Good command of English.
Nice to Have
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Knowledge of containerization tools like Docker and orchestration with Kubernetes.
  • Familiarity with CI/CD pipelines for big data workflows.
  • Experience in optimizing Spark jobs for large-scale data processing.
  • Academic background in Computer Science, Data Engineering, or a related field.

At Link Group, we specialize in building tech teams for Fortune 500 companies and some of the world's most exciting startups. Our mission is to connect talented professionals with opportunities that align with their skills, interests, and career aspirations.

We are currently looking for a Big Data Engineer with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.

About the Project

The project focuses on building a high-performance data platform for the finance/stock exchange industry, processing massive datasets to enable real-time analytics, reporting, and decision-making. You will work with modern big data tools and frameworks to ensure scalability and efficiency.

Tech Stack
  • Scala
  • Apache Spark
  • Hadoop ecosystem (HDFS, Hive, HBase)
  • Kafka
  • SQL/NoSQL databases
  • Cloud platforms (AWS, Azure, GCP)
  • Docker, Kubernetes
  • Agile development methodologies
What We Offer
  • Tailored opportunities to match your professional interests and goals.
  • A leadership role in a dynamic and collaborative work environment.
  • Access to exciting and diverse projects for global clients.
  • Competitive compensation aligned with your expertise.
  • Ongoing opportunities for professional growth and development.

Apply today and join us at Link Group to make an impact

,[Design, implement, and optimize big data processing pipelines using Scala and Spark., Work with massive datasets, ensuring scalability and performance., Collaborate with data scientists and analysts to develop data solutions., Monitor and troubleshoot data workflows to ensure reliability and efficiency., Integrate with data sources and ensure proper data ingestion and transformation., Research emerging big data technologies to improve the architecture.] Requirements: Big data, Scala, Spark, Hadoop, Kafka, SQL, NoSQL, Git, ETL, Cloud platform, AWS, Azure, GCP, Docker, Kubernetes, CI/CD Pipelines Tools: Agile, Scrum.

  • Linux Engineer for Big Data Validation

    2 days ago

    Remote, Wrocław, Czech Republic beBeeData Full time 6,000 - 8,000

    As a junior linux engineer in big data validation, you will join an international team and collaborate with industry leaders.Our company is a global leader in media analytics, providing insights into consumer behavior and digital engagement.We are seeking a skilled engineer to work closely with our ai and data engineering teams to ensure the quality of data,...

  • Senior Big Data Engineer @ Matrix Global Services

    22 hours ago

    Remote, Czech Republic Matrix Global Services Full time

    At least 2 years’ experience with Java Experience in building, optimizing, and maintaining large-scale big data pipelines using popular open-source frameworks (Kafka, Spark, Hive, Presto, Airflow, etc) Experience with SQL/NoSQL/key value DBs Hands-on experience in Spring, Sprint Boot Experience with AWS cloud services such as EMR, Aurora, Snowflake, S3,...

  • Junior Linux Engineer in Big Data Validation @

    2 days ago

    Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    An ideal candidate would have:A solid foundation in Python programming, future proficiency in SQL, and a solid basic understanding of statistical concepts. Python programming, proficiency in SQL, and a basic understandingKnowledge of testing methodologies and practical experience in API testing and data testingExperience in testing large datasets is...

  • High-Performance Big Data Expert

    24 hours ago

    Remote, Wrocław, Czech Republic beBeeDataEngineer Full time 18,000 - 25,000

    Big Data Processing EngineerWe are looking for a skilled Big Data Processing Engineer to join our team. As a key member of our engineering group, you will be responsible for designing and implementing scalable data processing pipelines using Java and Spark.Your primary focus will be on developing and maintaining high-performance data processing systems that...

  • Senior Big Data Engineer

    22 hours ago

    Remote, Czech Republic SoftServe Full time

    IF YOU ARE An experienced Data Engineer with 5+ years of hands-on practice in designing and building scalable data pipelines Proficient in working with Graph Databases and understanding graph structures, relationships, and performance considerations Skilled in Python and SQL for data transformation, integration, and logic building Familiar with Databricks...

  • Junior Linux Engineer in Big Data Validation @ Comscore

    22 hours ago

    Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    An ideal candidate would have: A solid foundation in Python programming, future proficiency in SQL, and a solid basic understanding of statistical concepts. Python programming, proficiency in SQL, and a basic understanding Knowledge of testing methodologies and practical experience in API testing and data testing Experience in testing large datasets is...

  • Engineering Manager

    22 hours ago

    Remote, Warszawa, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you’ll need to succeed in this role: Bachelor’s or higher in Computer Science, Mathematics, Physics, or related field. Hands-on experience with Python and Data Science applications (Generative AI, LLMs, Machine Learning, Predictive Modeling, NLP, Computer Vision, Deep Learning). Proven track record in managing technical teams and leading end-to-end...

  • Big Data Java Developer @

    1 week ago

    Remote, Wrocław, Gdańsk, Warsaw, Kyiv, Kraków, Czech Republic RemoDevs Full time

    3+ years of experience in Java development.Experience in Big Data - must.Experience with Java, Spring Boot, Kafka, MongoDB, Kubernetes, MySQL.Hands-on experience with Spring / Spring Boot.Experience with cloud platforms like AWS (EMR, Aurora, S3, Athena, Glue) is a plus.Ability to debug and solve issues in distributed production systems.Team player with...

  • Data Engineer

    1 week ago

    Remote, Czech Republic Link Group Full time

    Proven experience in data engineering with a focus on streaming.Strong proficiency in Confluent Kafka and Spark Structured Streaming.Experience with CDC and other data extraction techniques.Hands-on programming experience: Python, SQL, Bash, Node.js, Linux/Unix Shell.Familiarity with data engineering best practices: versioning, release management, agile...

  • Project Manager

    22 hours ago

    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    🎯 What you’ll need to succeed in this role: Bachelor’s or higher in Computer Science, Mathematics, Physics, or related field. Proven track record in managing technical teams and leading end-to-end projects. Experience working with international corporate clients. Strong critical thinking and problem-solving abilities. Excellent communication and...