Big Data Engineer

1 day ago

Warszawa, Czech Republic Integral Solutions Full time

Minimum 3 years of experience in Python or Scala programming Commercial experience and exposure to BigData technologies, Spark is a must Familiarity with Data Warehouse principles Knowledge of good engineering practices, Big Data processing, including Design standards, Data Modelling techniques, coding, documentation, testing and implementation Experience with various data formats: JSON, PARQUET, ORC, AVRO Understanding database types and usage scenarios, e.g. Hive, Kudu, HBase, Iceberg, etc. Advanced knowledge of SQL Experience in integrating data from multiple data sources Knowledge of tools for building projects/applications, e.g. Maven Advanced knowledge of Polish and good knowledge of English We are looking for a skilled BigData Engineer to join an exciting project for a leading banking client, one of the top players in the Polish market. You will work on building and improving Big Data solutions that support key business processes, using modern technologies and best engineering practices. It's a Warsaw-based opportunity. The team visit the office once in two weeks. ,[Write and maintain data pipelines and applications using Python or Scala, Work with Apache Spark and other Big Data tools to process large amounts of data, Use data warehouse principles to keep data well-structured and reliable, Follow good engineering practices: clear code, proper testing, documentation, and clean design, Handle different data formats like JSON, Parquet, ORC, and Avro, Write and improve SQL queries to work with data efficiently, Combine data from different sources into a single system] Requirements: Spark, Python, Hadoop, HDFS, Kafka, Cloud Tools: . Additionally: Sport subscription, Private healthcare, Modern office.

  • Programista Big Data @ IT LeasingTeam

    2 weeks ago

    Warszawa, Czech Republic IT LeasingTeam Full time

    Min. 3 lata doświadczenia w programowaniu w Apache Spark, szczególnie PySpark Praktyczna znajomość Hadoop w kontekście tworzenia rozwiązań do przetwarzania dużych zbiorów danych (batch i/lub streaming) Umiejętność projektowania i implementacji procesów przetwarzania danych w ekosystemie Big Data Doświadczenie w pracy z Python i SQL Znajomość...

  • Java Developer/Data Engineer @ Devire

    1 week ago

    Warszawa, Czech Republic Devire Full time

    Background as a Java Senior Developer who transitioned into Data Engineering. Solid understanding of data engineering principles and Big Data processing. Hands-on experience with Scala and Apache Spark. Experience with software development. Familiarity with CI/CD pipelines, code quality monitoring, and cloud environments (preferably Azure). ...

  • Data Engineer @ 1dea

    1 week ago

    Kraków, Gdańsk, Wrocław, Warszawa, Lublin, Czech Republic 1dea Full time

    Minimum 5 lat doświadczenia w IT applications management Doświadczenie i wiedza z zakresu user access management Dobra znajomość SQL Umiejętność programowania w Python oraz znajomość Spark Podstawowa znajomość systemów Unix i środowisk Big Data Umiejętność koordynacji z zespołami globalnymi i współpracy w międzynarodowym...

  • Senior Data Engineer @ Welltech

    1 week ago

    Remote, Warszawa, Czech Republic Welltech Full time

    What We're Looking For As a Senior Data Engineer, you will play a crucial role in building and maintaining the foundation of our data ecosystem. You’ll work alongside data engineers, analysts, and product teams to create robust, scalable, and high-performance data pipelines and models. Your work will directly impact how we deliver insights, power product...

  • Data Engineer @ Scalo

    1 day ago

    Warszawa, Czech Republic Scalo Full time

    Ta oferta jest dla Ciebie, jeśli: masz co najmniej 3-4 lata doświadczenia w branży IT, posiadasz wiedzę z zakresu Big Data, Hurtowni Danych i Zarządzania Danymi, masz minimum 2-3 lata doświadczenia w programowaniu procesów Spark w Pythonie (lub Scali), pracowałeś(-aś) z różnymi formatami danych: JSON, PARQUET, ORC, AVRO, rozumiesz typy baz danych...

  • Data Platform DevOps Engineer

    1 week ago

    Warszawa, Czech Republic T-Mobile Polska Full time

    3+ years of experience as a DevOps Engineer with strong hands-on expertise in data management in GCP, kubernetes, Spark Prior experience supporting data infrastructure or analytics platforms Experience in Infrastructure as Code tools. Skilled in scripting languages for automation tasks. Familiarity with cloud monitoring tools. Strong understanding of...

  • Lead Data Architect Master Data Asset @ Bayer

    2 weeks ago

    Warszawa, Czech Republic Bayer Full time

    Qualifications & Competencies (education, skills, experience): Master degree in computer science, big data, engineering, data management or a comparable subject 5-8+ years working experience in the field of master data management for data analytics, experience in the area of big data and data science as a data- & solution architect and with experience in...

  • Data Platform Architect

    6 days ago

    Warszawa, Czech Republic T-Mobile Polska Full time

    5+ years experience in data platform architecture or engineering. Deep knowledge of GCP (BigQuery, Dataflow, Dataproc Pub/Sub), Spark, Kubernetes, DWH, Big Data. Proven leadership in hybrid cloud/on-premise integration projects. Strong skills in technical documentation, system design and stakeholder management. Experience with cloud-native migrations and...

  • Data Engineer

    2 weeks ago

    Remote, Warszawa, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you’ll need to succeed in this role: At least 3 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes. Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. Hands-on with Big Data technologies like Spark, Cloudera Data Platform,...

  • Lead Data Engineer

    2 weeks ago

    Remote, Warszawa, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    🎯 What you'll need to succeed in this role: 5+ years of proven commercial experience in implementing, developing, or maintaining Big Data systems. Strong programming skills in Python or Java/Scala: writing a clean code, OOP design. Experience in designing and implementing data governance and data management processes. Familiarity with Big...