Big Data Engineer
3 days ago
- At least 3+ years of experience in big data engineering.
- Proficiency in Scala and experience with Apache Spark.
- Strong understanding of distributed data processing and frameworks like Hadoop.
- Experience with message brokers like Kafka.
- Hands-on experience with SQL/NoSQL databases.
- Familiarity with version control tools like Git.
- Solid understanding of data architecture and ETL processes.
- Good command of English.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Knowledge of containerization tools like Docker and orchestration with Kubernetes.
- Familiarity with CI/CD pipelines for big data workflows.
- Experience in optimizing Spark jobs for large-scale data processing.
- Academic background in Computer Science, Data Engineering, or a related field.
At Link Group, we specialize in building tech teams for Fortune 500 companies and some of the world's most exciting startups. Our mission is to connect talented professionals with opportunities that align with their skills, interests, and career aspirations.
We are currently looking for a Big Data Engineer with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.
About the ProjectThe project focuses on building a high-performance data platform for the finance/stock exchange industry, processing massive datasets to enable real-time analytics, reporting, and decision-making. You will work with modern big data tools and frameworks to ensure scalability and efficiency.
Tech Stack- Scala
- Apache Spark
- Hadoop ecosystem (HDFS, Hive, HBase)
- Kafka
- SQL/NoSQL databases
- Cloud platforms (AWS, Azure, GCP)
- Docker, Kubernetes
- Agile development methodologies
- Tailored opportunities to match your professional interests and goals.
- A leadership role in a dynamic and collaborative work environment.
- Access to exciting and diverse projects for global clients.
- Competitive compensation aligned with your expertise.
- Ongoing opportunities for professional growth and development.
Apply today and join us at Link Group to make an impact
,[Design, implement, and optimize big data processing pipelines using Scala and Spark., Work with massive datasets, ensuring scalability and performance., Collaborate with data scientists and analysts to develop data solutions., Monitor and troubleshoot data workflows to ensure reliability and efficiency., Integrate with data sources and ensure proper data ingestion and transformation., Research emerging big data technologies to improve the architecture.] Requirements: Big data, Scala, Spark, Hadoop, Kafka, SQL, NoSQL, Git, ETL, Cloud platform, AWS, Azure, GCP, Docker, Kubernetes, CI/CD Pipelines Tools: Agile, Scrum.-
Innovative Big Data Solutions Leader
1 week ago
Remote, Warsaw, Czech Republic beBeeDataEngineer Full time €60,000 - €80,000Job OverviewWe are seeking an experienced Senior Data Engineer to support our global customers in building innovative big data products and services.The ideal candidate will have expertise in Azure and big data engineering, with a strong understanding of data management platforms and scalable architectures.
-
Big Data Solutions Architect
1 week ago
Remote, Czech Republic SoftServe Full timeIF YOU AREWell-experienced in building large-scale data platforms and decision-support systems (at least 7 years)Proficient in delivering big data and analytics solutionsFamiliar with modern data and analytics technology stacks and architectural methodologies, like Attribute Driven Design (ADD)Skilled in designing and implementing enterprise-scale data and...
-
Data Engineer
1 week ago
Remote, Czech Republic Link Group Full timeMust-Have QualificationsAt least 3+ years of experience in data engineering.Strong expertise in one or more cloud platforms: AWS, GCP, or Azure.Proficiency in programming languages like Python, SQL, or Java/Scala.Hands-on experience with big data tools such as Hadoop, Spark, or Kafka.Experience with data warehouses like Snowflake, BigQuery, or...
-
Big Data Architect Position
2 days ago
Remote, Warszawa, Czech Republic beBeeData Full time 1,200,000 - 1,400,000Job Title: Big Data ArchitectWe are seeking a skilled professional to lead the design, development and implementation of advanced data architecture solutions.At least 6 years of experience in big data domain with focus on large-scale solutions.Hands-on experience with artificial intelligence and machine learning integrated with big data platforms.Advanced...
-
Senior Data Engineer
1 week ago
Remote, Warszawa, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic beBeeData Full time 50,000 - 75,000About the RoleAs a Data Architect, you will play a crucial part in designing and developing scalable data management architectures, infrastructure, and platform solutions for streaming and batch processing using Big Data technologies like Apache Spark, Hadoop, Iceberg. Your expertise will help us leverage cutting-edge technologies to drive business growth...
-
Big Data Solutions Architect
1 week ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic beBeeDataPlatform Full time €80,000 - €95,000Job Title: Data Platform ArchitectWe are seeking a skilled Data Platform Architect to design and implement scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.Key Responsibilities:Design and optimize end-to-end data platforms ensuring high availability,...
-
Senior Data Engineer @
1 week ago
Remote, Czech Republic Matrix Global Services Full time+3 years of experience in large scale, distributed server side, backend developmentExtensive experience in stream & batch big data pipeline processing using Apache SparkExperience with Linux, Docker, and KubernetesExperience in working with cloud providers (e.g., AWS, GCP)Strong experience with event streaming platforms like Kafka or its alternatives, such...
-
Senior Data Engineer Position
7 days ago
Remote, Czech Republic beBeeData Full time 1,000,000 - 1,500,000Job Title:Data ArchitectDescription:We're seeking an experienced Data Architect to design and implement robust data pipelines and perform ETL/ELT processes. You will work on data integration, modeling, analytics, and visualization while ensuring data quality and supporting solution engineering activities.Requirements:Proven experience building data pipelines...
-
Senior Azure Data Engineer @
1 week ago
Remote, Warsaw, Czech Republic C&F S.A. Full timeWhat you will need: 4+ years of experience in Azure and 5+ of industrial experience in the domain of large-scale data management, visualization and analytics;Hands-on knowledge of the following data services and technologies in Azure (for example Databricks, Data Lake, Synapse, Azure SQL, Azure Data Factory, Azure Data Explorer);Good understanding of Azure...
-
Chief Data Strategist
1 week ago
Remote, Czech Republic beBeeData Full time 1,200,000 - 1,600,000Big Data Solutions ArchitectAre you a master of big data and analytics? Do you have experience in designing and implementing enterprise-scale data solutions using Google Cloud?We are looking for a skilled Big Data Solutions Architect to join our team.Job DescriptionAs a Big Data Solutions Architect, you will be responsible for:Designing and implementing...