Strategic Data Engineering Lead

15 hours ago


Remote, Czech Republic Link Group Full time

We are currently seeking a Strategic Data Engineering Lead with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.

About the Role

The ideal candidate will have experience in designing, implementing, and optimizing big data processing pipelines using Scala and Spark. They will work with massive datasets to ensure scalability and performance, collaborating with data scientists and analysts to develop data solutions.

Responsibilities include monitoring and troubleshooting data workflows to ensure reliability and efficiency, integrating with data sources, and ensuring proper data ingestion and transformation. Additionally, the successful candidate will research emerging big data technologies to improve the architecture.

About the Project

The project focuses on building a high-performance data platform for the finance/stock exchange industry, processing massive datasets to enable real-time analytics, reporting, and decision-making. You will work with modern big data tools and frameworks to ensure scalability and efficiency.

Tech Stack
  • Scala
  • Apache Spark
  • Hadoop ecosystem (HDFS, Hive, HBase)
  • Kafka
  • SQL/NoSQL databases
  • Cloud platforms (AWS, Azure, GCP)
  • Docker, Kubernetes
Requirements
  • Big data engineering expertise with at least 3+ years of experience.
  • Proficiency in Scala and experience with Apache Spark.
  • Strong understanding of distributed data processing and frameworks like Hadoop.
  • Experience with message brokers like Kafka.
  • Hands-on experience with SQL/NoSQL databases.
  • Familiarity with version control tools like Git.
  • Solid understanding of data architecture and ETL processes.
  • Good command of English.
Benefits
  • Tailored opportunities to match your professional interests and goals.
  • A leadership role in a dynamic and collaborative work environment.
  • Access to exciting and diverse projects for global clients.
  • Competitive compensation aligned with your expertise.
  • Ongoing opportunities for professional growth and development.


  • Remote, Czech Republic Link Group Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our team at Link Group. This is a unique opportunity to lead and mentor a team of data engineers while actively contributing to pipeline development, architecture design, and system optimization.Key ResponsibilitiesDesign and implement scalable, high-performance data architectures that...


  • Remote, Czech Republic Link Group Full time

    7+ years of experience in data engineering, including 2+ years in a leadership or architecture role.Expertise in Airflow, Snowflake, DBT, and advanced knowledge of Python, Spark, SQL, and AWS.Proven experience in designing and deploying large-scale data warehouses and building complex data models.Hands-on experience with third-party APIs and external data...


  • Remote, Lisbon, Frankfurtammain, Heidelberg, Warszawa, Czech Republic Data Science UA Full time

    About Data Science UA:">We are a service company with strong data science and AI expertise, fostering the largest Data Science Community in Eastern Europe.About Our Client:">The company is a market-leading intelligence platform for paid search advertising, leveraging artificial search intelligence and industry knowledge to drive value from PPC budgets.About...


  • Remote, Czech Republic ALM Services Technology Group Full time

    We are seeking a highly experienced Data Engineer to lead our team in building a next-generation Global Data Lake and Analytics platform.This role involves designing and delivering data models, which power business intelligence initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases. You will work closely with data architects on...


  • Remote, Warsaw, Czech Republic GetInData | Part of Xebia Full time

    Proficiency in a programming language like Python / Scala or JavaKnowledge of Lakehouse platforms - DatabricksExperience working with dbtFamiliarity with Version Control Systems, particularly GITExperience as a programmer and knowledge of software engineering, good principles, practices, and solutionsExtensive experience in Microsoft AzureKnowledge of at...


  • Remote, Czech Republic ALM Services Technology Group Full time

    We are currently seeking resources with experience in building and taking to production low latency, Massive Parallel Processing (MPP) data and analytic systems, ideally on Hadoop, Scala and Spark. The Candidate that meets the following criteria:∙Computer Science Degree/Student ∙3+ years strong native SQL skills ∙3+ years strong experience in...

  • Lead Data Scientist

    24 hours ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:6+ years of commercial experience in designing and implementing scalable AI solutions (Machine Learning, Predictive Modeling, Optimization, NLP, Computer Vision, GenAI).Experience in Machine Learning projects leadership and team mentoring.Proficiency in developing ML algorithms from scratch to production...


  • Remote, Czech Republic Matrix Global Services Full time

    Job DescriptionWe are seeking a highly skilled Lead Data Engineer to join our team at Matrix Global Services.About the RoleThe successful candidate will lead development projects of critical, high-availability cloud-scale services and APIs. They will support clients with large amounts of data and scalability in mind.Key Responsibilities:Leverage expertise in...


  • Remote, Warszawa, Czech Republic Syncron Full time

    About SyncronSyncron is a leading SaaS company with over 20 years of experience, specializing in aftermarket solutions. Our Service Lifecycle Management Platform offers domain-fit solutions for supply chain optimization, pricing strategy, service fulfillment, warranty management, field service management, service parts management, and knowledge management.We...


  • Remote, Warszawa, Czech Republic SquareOne Full time

    Job DescriptionSquareOne is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for developing robust and maintainable data pipelines that meet the needs of our business stakeholders.About the RoleThis is a challenging opportunity for an experienced data engineer to take ownership of...

  • AI/ML Engineer @

    1 week ago


    Remote, Czech Republic PAR Data Central Full time

    Position Overview: As an AI/ML Engineer, you will play a crucial role in enhancing our platform's capabilities by developing and refining machine learning models that drive accurate forecasting, event analysis, data-driven decision-making, and more. You will collaborate closely with product owners and engineering teams to implement scalable AI solutions that...

  • Data Engineer

    4 days ago


    Remote, Warsaw, Czech Republic GetInData | Part of Xebia Full time

    Proficiency in a programming language like Python and SQLDeep understanding of data warehousing concepts and experience with platforms such as Snowflake, BigQuery, or RedshiftExperience as a programmer and knowledge of software engineering, good principles, practices, and solutionsFamiliarity with cloud GCP / AWSFamiliarity with DevOps area and tools - GKE,...


  • Remote, Czech Republic ETFbook Full time

    As a key member of the ETFbook team, you will be responsible for designing and maintaining a scalable data platform using Python, .NET, and Azure Services.About UsETFbook is a fast-paced ETF data analytics startup. We offer a cutting-edge platform providing businesses with actionable insights.You'll join a highly skilled data engineering team, part of a...


  • Remote, Kraków, Wrocław, Warszawa, Czech Republic N-iX Full time

    Must have:Python Development: Minimum 5 years of professional experience in production environments, emphasising performance optimisation and code quality.Ingestion and modelling:Experience with Python and orchestration tools like Airflow is beneficial.SQL Proficiency: Advanced knowledge of SQL:At least one of PostgreSQL, MySQL, MSSQLAbility to write complex...


  • Remote, Warszawa, Czech Republic Sunscrapers Full time

    At Sunscrapers, we are looking for a skilled Software Engineering Lead to join our team in developing a holistic data platform for a leading US-based healthcare company.The ideal candidate will have strong experience in designing and optimizing data models in Django, managing and maintaining Docker environments, and utilizing AWS services and infrastructure...


  • Remote, Czech Republic Strategic Staffing Solutions Full time

    Job DescriptionWe are seeking an experienced Axonius Cybersecurity Asset Management Solutions Engineer to join our team at Strategic Staffing Solutions International. Our client, a major player in the healthcare industry, requires a highly skilled professional to oversee the end-to-end implementation of Axonius cybersecurity asset management solutions for a...

  • Lead ML Engineer @

    3 days ago


    Remote, Warsaw, Czech Republic hubQuest Full time

    Advanced degree in computer science, statistics, or a related STEM field.At least 5 years of ML engineering (or engineering support for data science) experience in an industrial/commercial setting.Deep knowledge of ML algorithms and data science concepts.Experience with ML frameworks such as TensorFlow, PyTorch, and MLflow.Strong Python software...


  • Remote, Czech Republic Link Group Full time

    About Link GroupLink Group is a leading provider of data solutions, serving clients across various industries.


  • Remote, Wrocław, Gdańsk, Rzeszów, Czech Republic Xebia sp. z o.o. Full time

    7+ years in a data engineering role, with hands-on experience in building data processing pipelines,experience in leading the design and implementing of data pipelines and data products,proficiency with GCP services, for large-scale data processing and optimization,extensive experience with Apache Airflow, including DAG creation, triggers, and workflow...


  • Remote, Czech Republic PAR Data Central Full time

    Company Overview:PAR Data Central is a leading restaurant technology provider to top brands worldwide, offering solutions used by tens of millions of guests daily across 120 countries.We believe in building open and fast technology that empowers our customers to innovate.Job Summary:We are seeking an experienced Machine Learning Engineer to join our Data...