Big Data Specialist for Innovative Projects

4 days ago


Remote Warsaw Wrocław Białystok Kraków Gdańsk, Czech Republic Addepto Full time
Company Overview

Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups.

Job Description
  • Design and development of a universal data platform for global aerospace companies.
  • Data Platform Transformation for energy management association body.
  • Design of the data transformation and following data ops pipelines for global car manufacturer.

We're seeking a talented Data Engineer to join our team and work on exciting projects that leverage cutting-edge technologies.

Key Responsibilities:
  • Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.
  • Architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability.
  • Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
  • Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources, ensuring efficiency and scalability.
  • Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment.
  • Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and consistency.
  • Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.
  • Ensure data security, compliance, and governance best practices are followed across all data pipelines.
Requirements
  • Python, SQL, ETL, Azure, Airflow, Databricks, Spark, Docker, CI/CD, Kubernetes, Kafka, Power BI, Dagster.
  • Jira, Confluence, Wiki, GitHub, Agile, Scrum, Kanban.
Benefits
  • Work in a supportive team of passionate enthusiasts of AI & Big Data.
  • Engage with top-tier global enterprises and cutting-edge startups on international projects.
  • Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.
  • Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences.
  • Choose from various employment options: B2B, employment contracts, or contracts of mandate.
  • Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.
  • Participate in team-building events and utilize the integration budget.
  • Celebrate work anniversaries, birthdays, and milestones.
  • Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
  • Get full work equipment for optimal productivity, including a laptop and other necessary devices.
  • With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups.
  • Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.

  • Data Engineer

    4 days ago


    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Job OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We are seeking an experienced Data Engineer - AI & Big Data Specialist to join our team.Key Responsibilities:Design, develop, and maintain high-performance data processing platforms for automotive and aerospace industries.Create scalable and reliable data...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU.We have earned recognition by Forbes as one of the top 10 AI companies due to...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Addepto is a leading consulting and technology company specializing in AI and Big Data. Our expertise helps clients deliver innovative data projects, partnering with top-tier global enterprises and pioneering startups.Job OverviewThis role involves working as a Senior Data Engineer on challenging projects across various industries, leveraging cutting-edge...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data. We help clients deliver innovative data projects by partnering with top-tier global enterprises and pioneering startups.Job DescriptionWe are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will design and develop...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    About AddeptoWe are a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects.Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI companies.


  • Remote, Czech Republic Big Human Full time

    About the RoleWe are seeking a seasoned Senior Flutter Developer to join our team at Big Human, a digital product studio with a passion for creating innovative online experiences. As a key member of our development team, you will be responsible for designing and delivering high-quality cross-platform mobile applications that exceed user expectations.Key...


  • Remote, Warsaw, Czech Republic ElevenLabs Full time

    About the RoleWe are seeking a highly motivated and driven individual to join our Data Ops Team as a Data Science Operations Specialist.The ideal candidate will have strong attention to detail, excellent communication skills, and the ability to work autonomously with minimal supervision.Key Responsibilities:Work closely with Research to develop clear project...


  • Remote, Gdańsk, Wrocław, Warsaw, Kraków, Czech Republic Elitmind Full time

    About UsElitmind is a leading provider of cutting-edge data and AI solutions, empowering businesses to unlock their full potential.Job DescriptionWe are seeking an experienced Data Platform Specialist to join our team at Elitmind. In this role, you will play a key part in delivering innovative projects that leverage the latest data and AI technologies.Key...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    We are seeking a seasoned Petabyte-Scale Big Data Engineer to join our team at Comscore (via CC). As a key member of our international team, you will play a vital role in driving projects forward and improving existing systems.About the RoleThe ideal candidate will have extensive experience with petabyte-scale big data pipelines using Scala, Spark,...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 6 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design.Hands-on with Big Data technologies like Spark, Cloudera Data Platform, Airflow,...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    As a Cloud Data Platform Architect at Addepto, you will be part of a dynamic team that specializes in AI and Big Data solutions for top-tier global enterprises.We are seeking a highly skilled professional with expertise in designing and developing scalable data processing pipelines using Big Data technologies such as Databricks, Apache Airflow, and Dagster....


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have: 2+ years of experience with Linux Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows) 1+ years of experience with Spark,  primarily using Scala for Big data...

  • Data Scientist

    2 days ago


    Remote, Warszawa, Gdańsk, Wrocław, Białystok, Kraków, Czech Republic Addepto Full time

    What you'll need to succeed in this role:Proven commercial experience designing and implementing scalable AI solutions (Machine Learning, Predictive Modeling, Optimization, NLP, Computer Vision, GenAI).Proficiency in developing ML algorithms from scratch to production deployment.Strong programming skills in Python: writing clean code, OOP design,...


  • Remote, Czech Republic Adaptiq Full time

    At least 5 years of experience in Data Engineering domainAt least 2 years of experience with GoLangProficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databasesExperienced with big data tools such as Spark or Flink to enhance system performance and scalabilityProven experience with Kubernetes (K8S) and familiarity with GTP tools to ensure...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Very good understanding of Linux internals (processes/threads, service management, resource allocation)Linux as a daily driver of operations1+ years of commercial experience with JavaProven ability to debug JVM/Java (hopefully in Spark ecosystem)Ability to design high performance processing pipelinesHands-on, proactive...


  • Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 4 years commercial experience in a Data Engineer role. Experience with BigQuery on GCP as a data warehouse, with some existing tables already built (approx. 10% completed).Expertise in Looker for building and optimizing dashboards for management reporting.Strong experience with API integration,...


  • Remote, Gdańsk, Wrocław, Warsaw, Kraków, Czech Republic Elitmind Full time

    Tech SkillsRecent experience with SQL and SQL optimization techniques.General knowledge of ITIL processesUnderstanding of the Service Desk processes and support linesHands-on experience with BI tools for reporting and analysisStrong skills in database developmentExperience with DevOps practices and CI/CD implementation.Familiarity with Azure Data Factory,...


  • Remote, Wrocław, Czech Republic Comscore (via CC) Full time

    The candidate must have:Very good understanding of Linux internals (processes/threads, service management, resource allocation)Linux as a daily driver of operationsGood understanding of Spark internals and mechanicsKnowledge of Iceberg4+ years of commercial experience with JavaProven ability to debug JVM/Java (hopefully in Spark ecosystem)Ability to design...