Big Data Engineer

2 weeks ago

Remote, Czech Republic Link Group Full time

Must-Have Qualifications At least 3+ years of experience in big data engineering. Proficiency in Scala and experience with Apache Spark. Strong understanding of distributed data processing and frameworks like Hadoop. Experience with message brokers like Kafka. Hands-on experience with SQL/NoSQL databases. Familiarity with version control tools like Git. Solid understanding of data architecture and ETL processes. Good command of English. Nice to Have Experience with cloud platforms such as AWS, Azure, or GCP. Knowledge of containerization tools like Docker and orchestration with Kubernetes. Familiarity with CI/CD pipelines for big data workflows. Experience in optimizing Spark jobs for large-scale data processing. Academic background in Computer Science, Data Engineering, or a related field. At Link Group, we specialize in building tech teams for Fortune 500 companies and some of the world's most exciting startups. Our mission is to connect talented professionals with opportunities that align with their skills, interests, and career aspirations. We are currently looking for a Big Data Engineer with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects. About the Project The project focuses on building a high-performance data platform for the finance/stock exchange industry, processing massive datasets to enable real-time analytics, reporting, and decision-making. You will work with modern big data tools and frameworks to ensure scalability and efficiency. Tech Stack Scala Apache Spark Hadoop ecosystem (HDFS, Hive, HBase) Kafka SQL/NoSQL databases Cloud platforms (AWS, Azure, GCP) Docker, Kubernetes Agile development methodologies What We Offer Tailored opportunities to match your professional interests and goals. A leadership role in a dynamic and collaborative work environment. Access to exciting and diverse projects for global clients. Competitive compensation aligned with your expertise. Ongoing opportunities for professional growth and development. Apply today and join us at Link Group to make an impact ,[Design, implement, and optimize big data processing pipelines using Scala and Spark., Work with massive datasets, ensuring scalability and performance., Collaborate with data scientists and analysts to develop data solutions., Monitor and troubleshoot data workflows to ensure reliability and efficiency., Integrate with data sources and ensure proper data ingestion and transformation., Research emerging big data technologies to improve the architecture.] Requirements: Big data, Scala, Spark, Hadoop, Kafka, SQL, NoSQL, Git, ETL, Cloud platform, AWS, Azure, GCP, Docker, Kubernetes, CI/CD Pipelines Tools: Agile, Scrum.

  • Senior Big Data Engineer AWS @ SoftServe

    1 week ago

    Remote, Czech Republic SoftServe Full time

    IF YOU ARE A professional with 3+ year track record in the Big Data field Proficient in Python and SQL Experienced in developing data solutions on the AWS cloud platform Specializing in big data engineering with a focus on data pipeline creation Adept at batch and streaming processing Skilled in utilizing Apache Spark and Databricks Familiar with...

  • Big Data Developer @ ITMAGINATION

    6 days ago

    Remote, Czech Republic ITMAGINATION Full time

    Minimum 3 years of experience in data/software engineering (preferable in banking) Scala or Python, as well as Bash experience is preferable Experience with Integration Solutions (using API and Microservices) Programming backend applications with BigData technologies (Apache Spark) Knowledge of  Basics of cloud computing (Docker, Kubernetes, S3, Azure,...

  • Big Data Engineer @ ASTEK Polska

    2 days ago

    Remote, Warszawa, Czech Republic ASTEK Polska Full time

    Czego oczekujemy od Ciebie: Wykształcenia wyższego w obszarze Inżynierii IT, Inżynierii Danych lub Data Science 2–3 lat praktycznego doświadczenia w inżynierii Big Data Znajomości języków programowania i skryptowych: Spark, Scala, Java, Shell, Python Doświadczenia z Elasticsearch i bazami danych SQL Praktycznej znajomości narzędzi takich jak...

  • Big Data Developer @ ITMAGINATION

    2 weeks ago

    Remote, Czech Republic ITMAGINATION Full time

    Minimum 3 years of experience in data/software engineering (preferable in banking) Scala or Python, as well as Bash experience is preferable Experience with Integration Solutions (using API and Microservices) Programming backend applications with BigData technologies (Apache Spark) Knowledge of  Basics of cloud computing (Docker, Kubernetes, S3, Azure,...

  • Databricks Data Engineer

    2 weeks ago

    Remote, Czech Republic Upvanta Full time

    Requirements: Minimum 8 years of experience in Data Engineering At least 4 years of hands-on experience with Databricks, including services like data pipelines and Unity Catalog At least 2 years of experience working with Big Data technologies Proficiency in Python and SQL Solid background in data warehousing, ETL, distributed data processing, software...

  • Data Engineer @ Data Science UA

    4 days ago

    Remote, Kiev, Czech Republic Data Science UA Full time

    - 3-5+ years of experience working as a Data Engineer;- Master’s or PhD in Mathematics, Cybernetics, Computer Science, or a related field.- Experience building and scaling data pipelines on large tabular data using cloud and on-premises;- Understanding data requirements from the DS team;- Transforming raw data with issues into ready data for modeling;-...

  • Senior Data Engineer @ DCG

    1 week ago

    Remote, Czech Republic DCG Full time

    Minimum 5 years of experience in designing and building Business Intelligence, ETL/ELT, Data Warehouse, Data Lake, Data Lakehouse, Big Data, OLAP class solutions Practical knowledge of various relational (e.g., SQL Server, Oracle, Redshift, PostgreSQL, Teradata) and non-relational database engines (e.g., MongoDB, Cosmos DB, DynamoDB, Neo4j, HBase,...

  • AWS Data Engineer @ Experis Polska

    6 days ago

    Remote, Czech Republic Experis Polska Full time

    Requirements Minimum 6 years of experience in Big Data or Cloud projects involving processing and visualization of large and unstructured datasets across various phases of the SDLC Hands-on experience with AWS cloud services including Storage, Compute (and Serverless), Networking, and DevOps Solid understanding of AWS services, ideally supported by relevant...

  • Data Engineer

    2 weeks ago

    Remote, Czech Republic Link Group Full time

    Must-Have Qualifications At least 3+ years of experience in data engineering. Strong expertise in one or more cloud platforms: AWS, GCP, or Azure. Proficiency in programming languages like Python, SQL, or Java/Scala. Hands-on experience with big data tools such as Hadoop, Spark, or Kafka. Experience with data warehouses like Snowflake, BigQuery, or Redshift....

  • Data Architect

    4 days ago

    Remote, Czech Republic SoftServe Full time

    IF YOU ARE An architect specializing in data pipeline creation Experienced with both batch and streaming data processing Skilled in developing scalable data solutions using AWS services, building efficient data pipelines Familiar with Python, Scala, or Java and SQL for data manipulation and querying Knowledgeable in big data technologies such as Apache...