Data Engineer Lead for Scalable Data Platforms
4 days ago
As a Senior Data Engineer at Addepto, you will be responsible for designing and implementing end-to-end data platforms that are scalable, high-performing, and reliable.
Key Responsibilities- Data Platform Design
- Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.
- Architect and implement end-to-end data platforms ensuring high availability, performance, and reliability.
- Collaboration and Leadership
- Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
- Collaborate with Data Science teams on Machine Learning projects including text/image analysis, feature engineering, and predictive model deployment.
- Application Development
- Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources ensuring efficiency and scalability.
- Data Transformation
- Design and manage complex data transformations using Databricks, DBT, and Apache Airflow ensuring data integrity and consistency.
- Technical Expertise
- Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.
- Ensure data security, compliance, and governance best practices are followed across all data pipelines.
- Proficiency in Python, SQL, and ETL tools.
- Experience with Azure, Airflow, Databricks, Spark, Docker, CI/CD, Kubernetes, Kafka, Power BI, Dagster, and dbt.
- Knowledge of Agile methodologies and experience with Jira, Confluence, Wiki, GitHub, and Scrum/Kanban.
- Additional benefits include private healthcare, multisport card, referral bonus, MyBenefit cafeteria, international projects, flat structure, paid leave, training budget, language classes, team-building events, small teams, flexible employment options, flexible working hours, remote work possibility, free coffee, startup atmosphere, and no dress code.
-
Cloud Data Platform Architect
5 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeAs a Cloud Data Platform Architect at Addepto, you will be part of a dynamic team that specializes in AI and Big Data solutions for top-tier global enterprises.We are seeking a highly skilled professional with expertise in designing and developing scalable data processing pipelines using Big Data technologies such as Databricks, Apache Airflow, and Dagster....
-
Lead Data Engineer @
7 days ago
Remote, Warsaw, Kraków, Wrocław, Gdańsk, Czech Republic Elitmind Full time5+ years of experience in configuration/release management, deployment, maintenance and familiarity with various Data Platforms and practices in data areaExperience in creating frameworks, using automation tools and executing best practices in real world Data Platform implementation projectsKnowledge of enterprise architectures and technology trends,...
-
Warszawa, Gdańsk, Kraków, Lublin, Katowice, Opole, Czech Republic Capgemini Polska Sp. z o.o. Full timeAs a Data Engineering Lead at Capgemini Polska Sp. z o.o., you will play a key role in designing and implementing scalable, high-performance data pipelines on Google Cloud Platform (GCP).About the RoleThis position requires a skilled professional to lead the design and implementation of GCP-native data solutions, ensuring best practices in performance,...
-
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeAddepto is a leading consulting and technology company specializing in AI and Big Data. Our expertise helps clients deliver innovative data projects, partnering with top-tier global enterprises and pioneering startups.Job OverviewThis role involves working as a Senior Data Engineer on challenging projects across various industries, leveraging cutting-edge...
-
Senior Data Engineer
5 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeWhat you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...
-
Senior Data Engineer
4 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeWhat you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...
-
Data Engineer
4 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeJob OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We are seeking an experienced Data Engineer - AI & Big Data Specialist to join our team.Key Responsibilities:Design, develop, and maintain high-performance data processing platforms for automotive and aerospace industries.Create scalable and reliable data...
-
Senior Data Engineer
7 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeWhat you'll need to succeed in this role:At least 4 years commercial experience in a Data Engineer role. Experience with BigQuery on GCP as a data warehouse, with some existing tables already built (approx. 10% completed).Expertise in Looker for building and optimizing dashboards for management reporting.Strong experience with API integration,...
-
Senior Data Engineer
4 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeWhat you'll need to succeed in this role:At least 6 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.Hands-on with Big Data technologies like Spark, Cloudera Data Platform, Airflow,...
-
Lead Data Engineer @
5 days ago
Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full timeWhat you need to have to succeed in this roleDemonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Experience with Python, Spark, SQL, Databricks, Azure Function App, Azure DevOps and Terraform.Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory &...
-
Big Data Specialist for Innovative Projects
4 days ago
Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full timeCompany OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups.Job DescriptionDesign and development of a universal data platform for global aerospace companies.Data Platform Transformation for energy...
-
AI/ML Engineer @
3 days ago
Remote, Czech Republic PAR Data Central Full timePosition Overview: As an AI/ML Engineer, you will play a crucial role in enhancing our platform's capabilities by developing and refining machine learning models that drive accurate forecasting, event analysis, data-driven decision-making, and more. You will collaborate closely with product owners and engineering teams to implement scalable AI solutions that...
-
Lead Data Acquisition Engineer @
5 days ago
Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full timeWhat you need to have to succeed in this roleProgramming experience in the following languages: PowerShell, Terraform, Python, Windows command prompt and object orientated programming languages.Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Understanding of hardware and software principles and storage technologies...
-
Senior Data Architect
7 days ago
Remote, Warsaw, Kraków, Wrocław, Gdańsk, Czech Republic Elitmind Full timeCompany OverviewElitmind is a cutting-edge technology company that excels in delivering innovative data solutions to its clients.Job DescriptionWe are seeking an experienced Sr. Data Engineer to lead our team of Data Engineers and oversee the development and maintenance of data and reporting platforms.
-
Data Architect Lead
3 days ago
Remote, Warszawa, Czech Republic SquareOne Full timeJob DescriptionSquareOne is seeking a highly skilled Data Solution Architect to lead our data architecture efforts and drive the development of scalable, reliable, and high-performance data solutions.About the RoleWe are looking for an experienced technical leader who can provide strategic guidance on data architecture design, implementation, and deployment....
-
Remote, Czech Republic 7N Sp. z o.o. Full timeAbout the Role">We are seeking a skilled Senior Data Engineer to join our PS Sustainability team, supporting the development and professionalization of our data foundation. As a key member of our team, you will monitor and report sustainability metrics across Product Supply, Quality, and IT (PSQIT).Work Mode:">The position offers remote work with occasional...
-
Data Engineer
4 days ago
Remote, Kraków, Wrocław, Warszawa, Czech Republic N-iX Full timeTransforming Capital Projects with Intelligent Data SolutionsN-iX, a leading software development company, empowers users to digitally search, visualize, navigate, and collaborate on assets.About N-iXWe are a 30-year-old software expert driven by industry experts for industry experts. Our platform plays an active role in advancing the global energy...
-
Data Platform Innovation Expert
5 days ago
Remote, Gdańsk, Wrocław, Warsaw, Kraków, Czech Republic Elitmind Full timeAbout UsElitmind is a leading provider of cutting-edge data and AI solutions, empowering businesses to unlock their full potential.Job DescriptionWe are seeking an experienced Data Platform Specialist to join our team at Elitmind. In this role, you will play a key part in delivering innovative projects that leverage the latest data and AI technologies.Key...
-
Data Engineer
3 days ago
Remote, Warszawa, Czech Republic SquareOne Full timeJob Summary: At SquareOne, we're seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will play a vital role in developing and maintaining our data pipelines, ensuring they are robust, scalable, and reliable. About the Role: We're looking for someone with hands-on experience in data modeling techniques, ETL...
-
Data Platform Specialist @
5 days ago
Remote, Gdańsk, Wrocław, Warsaw, Kraków, Czech Republic Elitmind Full timeTech SkillsRecent experience with SQL and SQL optimization techniques.General knowledge of ITIL processesUnderstanding of the Service Desk processes and support linesHands-on experience with BI tools for reporting and analysisStrong skills in database developmentExperience with DevOps practices and CI/CD implementation.Familiarity with Azure Data Factory,...