Big Data Engineer

2 weeks ago

Remote, Czech Republic Link Group Full time
Must-Have Qualifications
  • At least 3+ years of experience in big data engineering.
  • Proficiency in Scala and experience with Apache Spark.
  • Strong understanding of distributed data processing and frameworks like Hadoop.
  • Experience with message brokers like Kafka.
  • Hands-on experience with SQL/NoSQL databases.
  • Familiarity with version control tools like Git.
  • Solid understanding of data architecture and ETL processes.
  • Good command of English.
Nice to Have
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Knowledge of containerization tools like Docker and orchestration with Kubernetes.
  • Familiarity with CI/CD pipelines for big data workflows.
  • Experience in optimizing Spark jobs for large-scale data processing.
  • Academic background in Computer Science, Data Engineering, or a related field.

At Link Group, we specialize in building tech teams for Fortune 500 companies and some of the world's most exciting startups. Our mission is to connect talented professionals with opportunities that align with their skills, interests, and career aspirations.

We are currently looking for a Big Data Engineer with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.

About the Project

The project focuses on building a high-performance data platform for the finance/stock exchange industry, processing massive datasets to enable real-time analytics, reporting, and decision-making. You will work with modern big data tools and frameworks to ensure scalability and efficiency.

Tech Stack
  • Scala
  • Apache Spark
  • Hadoop ecosystem (HDFS, Hive, HBase)
  • Kafka
  • SQL/NoSQL databases
  • Cloud platforms (AWS, Azure, GCP)
  • Docker, Kubernetes
  • Agile development methodologies
What We Offer
  • Tailored opportunities to match your professional interests and goals.
  • A leadership role in a dynamic and collaborative work environment.
  • Access to exciting and diverse projects for global clients.
  • Competitive compensation aligned with your expertise.
  • Ongoing opportunities for professional growth and development.

Apply today and join us at Link Group to make an impact

,[Design, implement, and optimize big data processing pipelines using Scala and Spark., Work with massive datasets, ensuring scalability and performance., Collaborate with data scientists and analysts to develop data solutions., Monitor and troubleshoot data workflows to ensure reliability and efficiency., Integrate with data sources and ensure proper data ingestion and transformation., Research emerging big data technologies to improve the architecture.] Requirements: Big data, Scala, Spark, Hadoop, Kafka, SQL, NoSQL, Git, ETL, Cloud platform, AWS, Azure, GCP, Docker, Kubernetes, CI/CD Pipelines Tools: Agile, Scrum.

  • Data Engineering Expert

    2 weeks ago

    Remote, Czech Republic beBeeDataEngineering Full time €70,000 - €95,000

    Job Title: Data Engineering ExpertWe are looking for an experienced Data Engineer to design and implement scalable data architectures.Key Responsibilities:Design and deploy big data systems using Apache Spark and KubernetesOptimize data storage and access using Iceberg and Parquet formatsCollaborate with data scientists and engineers to productionize ML...

  • Big Data Architect

    2 weeks ago

    Remote, Czech Republic beBeeDataArchitecture Full time 21,600 - 27,800

    Job Title: Data Architecture SpecialistAbout the Role:We are seeking a highly skilled Data Architecture Specialist to join our team. In this role, you will be responsible for designing and implementing data architectures that meet the needs of our business.Key Responsibilities:Develop, optimize and maintain big data (ELT/ETL) pipelines for statistical...

  • Chief Data Engineer

    17 hours ago

    Remote, Czech Republic beBeeData Full time €65,000 - €80,000

    We are seeking a talented Senior Data Scientist to join our organization and contribute to shaping the future of finance teams.Key Responsibilities:Design, build, and deploy machine learning models using frameworks like LangChain.Owning the full technical stack from data pipelines to deployment.Closing collaboration with engineers and product teams in...

  • Big Data Developer Specialist

    2 weeks ago

    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic beBeeData Full time 800,000 - 1,200,000

    Job OverviewWe are seeking a skilled Big Data Developer to join our team and contribute to the design, development, and implementation of innovative data solutions.Key ResponsibilitiesDesign and develop large-scale data systems using Big Data technologies such as Databricks, Apache Spark, and Airflow.Develop and maintain high-quality code in Python, ensuring...

  • Senior Data Engineering Position

    2 weeks ago

    Remote, Warsaw, Czech Republic beBeeDataEngineering Full time 800,000 - 1,200,000

    Senior Data Engineering PositionWe seek a seasoned Senior Data Engineer to lead and support data ingestion, staging, processing, and serving using MS Azure services as part of our Supply Chain Analytics team expansion.Key Responsibilities:Develop, optimize, and maintain big data (ELT/ETL) pipelines for statistical modeling and business intelligence...

  • Chief Snowflake Data Strategist

    2 weeks ago

    Remote, Czech Republic beBeeData Full time 1,200,000 - 1,500,000

    Lead Data ArchitectWe are seeking a highly experienced Lead Data Architect to join our team responsible for designing, implementing, and optimizing modern data solutions. The ideal candidate will have a strong background in data strategy, data engineering, platform architecture, modeling, business intelligence, big data, reporting, and data warehousing.

  • Java/Spark Big Data Developer @

    10 hours ago

    Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Good understanding of Spark internals and mechanics4+ years of commercial experience with JavaProven ability to debug JVM/Java (hopefully in Spark ecosystem)Ability to design high performance processing pipelinesHands-on, proactive approachFamiliarity with CI/CD pipelines and DevOps practicesProficiency in English enables effective...

  • Data Engineering Specialist

    2 weeks ago

    Remote, Warszawa, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic beBeeDataengineeringspecialist Full time €90,000 - €120,000

    Job OverviewThis role represents a Data Engineering Specialist who will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies.As a key member of our team, you will be responsible for designing and developing scalable data management architectures,...

  • Data Architect GCP @

    1 day ago

    Remote, Warsaw, Czech Republic SquareOne Full time

    7+ years of experience in data architecture, database design, and data engineeringProven expertise in Google Cloud Platform (GCP), including: Dataplex, BigQuery, Dataflow (Apache Beam) and other GCP-native toolsStrong experience with Apache-based data pipelining tools (Beam, Airflow, Kafka, Spark)Expertise in data modeling (conceptual, logical, physical)...

  • Senior Databricks Data Engineer @

    2 weeks ago

    Remote, Gdańsk, Wrocław, Warsaw, Kraków, Poznań, Czech Republic RemoDevs Full time

    Proven experience with Azure Databricks and Azure Data Factory (ADF).Strong skills in SQL and Python for data engineering.Experience in building pipelines and data models.Good English (minimum B2) to communicate in an international team.Experience with Agile methods and Azure DevOps. We are looking for skilled Data Engineers to join a team working on an...