Data Engineer Lead for Scalable Data Platforms

4 days ago


Remote Warsaw Wrocław Białystok Kraków Gdańsk, Czech Republic Addepto Full time
About the Role

As a Senior Data Engineer at Addepto, you will be responsible for designing and implementing end-to-end data platforms that are scalable, high-performing, and reliable.

Key Responsibilities
  • Data Platform Design
    • Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.
    • Architect and implement end-to-end data platforms ensuring high availability, performance, and reliability.
  • Collaboration and Leadership
    • Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
    • Collaborate with Data Science teams on Machine Learning projects including text/image analysis, feature engineering, and predictive model deployment.
  • Application Development
    • Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources ensuring efficiency and scalability.
  • Data Transformation
    • Design and manage complex data transformations using Databricks, DBT, and Apache Airflow ensuring data integrity and consistency.
  • Technical Expertise
    • Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.
    • Ensure data security, compliance, and governance best practices are followed across all data pipelines.
    Requirements
    • Proficiency in Python, SQL, and ETL tools.
    • Experience with Azure, Airflow, Databricks, Spark, Docker, CI/CD, Kubernetes, Kafka, Power BI, Dagster, and dbt.
    • Knowledge of Agile methodologies and experience with Jira, Confluence, Wiki, GitHub, and Scrum/Kanban.
    • Additional benefits include private healthcare, multisport card, referral bonus, MyBenefit cafeteria, international projects, flat structure, paid leave, training budget, language classes, team-building events, small teams, flexible employment options, flexible working hours, remote work possibility, free coffee, startup atmosphere, and no dress code.


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    As a Cloud Data Platform Architect at Addepto, you will be part of a dynamic team that specializes in AI and Big Data solutions for top-tier global enterprises.We are seeking a highly skilled professional with expertise in designing and developing scalable data processing pipelines using Big Data technologies such as Databricks, Apache Airflow, and Dagster....


  • Remote, Warsaw, Kraków, Wrocław, Gdańsk, Czech Republic Elitmind Full time

    5+ years of experience in configuration/release management, deployment, maintenance and familiarity with various Data Platforms and practices in data areaExperience in creating frameworks, using automation tools and executing best practices in real world Data Platform implementation projectsKnowledge of enterprise architectures and technology trends,...


  • Warszawa, Gdańsk, Kraków, Lublin, Katowice, Opole, Czech Republic Capgemini Polska Sp. z o.o. Full time

    As a Data Engineering Lead at Capgemini Polska Sp. z o.o., you will play a key role in designing and implementing scalable, high-performance data pipelines on Google Cloud Platform (GCP).About the RoleThis position requires a skilled professional to lead the design and implementation of GCP-native data solutions, ensuring best practices in performance,...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Addepto is a leading consulting and technology company specializing in AI and Big Data. Our expertise helps clients deliver innovative data projects, partnering with top-tier global enterprises and pioneering startups.Job OverviewThis role involves working as a Senior Data Engineer on challenging projects across various industries, leveraging cutting-edge...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...

  • Data Engineer

    4 days ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Job OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We are seeking an experienced Data Engineer - AI & Big Data Specialist to join our team.Key Responsibilities:Design, develop, and maintain high-performance data processing platforms for automotive and aerospace industries.Create scalable and reliable data...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 4 years commercial experience in a Data Engineer role. Experience with BigQuery on GCP as a data warehouse, with some existing tables already built (approx. 10% completed).Expertise in Looker for building and optimizing dashboards for management reporting.Strong experience with API integration,...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 6 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.Hands-on with Big Data technologies like Spark, Cloudera Data Platform, Airflow,...


  • Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this roleDemonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Experience with Python, Spark, SQL, Databricks, Azure Function App, Azure DevOps and Terraform.Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory &...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups.Job DescriptionDesign and development of a universal data platform for global aerospace companies.Data Platform Transformation for energy...

  • AI/ML Engineer @

    3 days ago


    Remote, Czech Republic PAR Data Central Full time

    Position Overview: As an AI/ML Engineer, you will play a crucial role in enhancing our platform's capabilities by developing and refining machine learning models that drive accurate forecasting, event analysis, data-driven decision-making, and more. You will collaborate closely with product owners and engineering teams to implement scalable AI solutions that...


  • Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this roleProgramming experience in the following languages: PowerShell, Terraform, Python, Windows command prompt and object orientated programming languages.Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Understanding of hardware and software principles and storage technologies...


  • Remote, Warsaw, Kraków, Wrocław, Gdańsk, Czech Republic Elitmind Full time

    Company OverviewElitmind is a cutting-edge technology company that excels in delivering innovative data solutions to its clients.Job DescriptionWe are seeking an experienced Sr. Data Engineer to lead our team of Data Engineers and oversee the development and maintenance of data and reporting platforms.

  • Data Architect Lead

    3 days ago


    Remote, Warszawa, Czech Republic SquareOne Full time

    Job DescriptionSquareOne is seeking a highly skilled Data Solution Architect to lead our data architecture efforts and drive the development of scalable, reliable, and high-performance data solutions.About the RoleWe are looking for an experienced technical leader who can provide strategic guidance on data architecture design, implementation, and deployment....


  • Remote, Czech Republic 7N Sp. z o.o. Full time

    About the Role">We are seeking a skilled Senior Data Engineer to join our PS Sustainability team, supporting the development and professionalization of our data foundation. As a key member of our team, you will monitor and report sustainability metrics across Product Supply, Quality, and IT (PSQIT).Work Mode:">The position offers remote work with occasional...

  • Data Engineer

    4 days ago


    Remote, Kraków, Wrocław, Warszawa, Czech Republic N-iX Full time

    Transforming Capital Projects with Intelligent Data SolutionsN-iX, a leading software development company, empowers users to digitally search, visualize, navigate, and collaborate on assets.About N-iXWe are a 30-year-old software expert driven by industry experts for industry experts. Our platform plays an active role in advancing the global energy...


  • Remote, Gdańsk, Wrocław, Warsaw, Kraków, Czech Republic Elitmind Full time

    About UsElitmind is a leading provider of cutting-edge data and AI solutions, empowering businesses to unlock their full potential.Job DescriptionWe are seeking an experienced Data Platform Specialist to join our team at Elitmind. In this role, you will play a key part in delivering innovative projects that leverage the latest data and AI technologies.Key...

  • Data Engineer

    3 days ago


    Remote, Warszawa, Czech Republic SquareOne Full time

    Job Summary: At SquareOne, we're seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will play a vital role in developing and maintaining our data pipelines, ensuring they are robust, scalable, and reliable. About the Role: We're looking for someone with hands-on experience in data modeling techniques, ETL...


  • Remote, Gdańsk, Wrocław, Warsaw, Kraków, Czech Republic Elitmind Full time

    Tech SkillsRecent experience with SQL and SQL optimization techniques.General knowledge of ITIL processesUnderstanding of the Service Desk processes and support linesHands-on experience with BI tools for reporting and analysisStrong skills in database developmentExperience with DevOps practices and CI/CD implementation.Familiarity with Azure Data Factory,...