Ingestion Data Engineer

3 days ago

Kraków, Czech Republic Mindbox Sp.z.o.o. Full time

Hadoop, Hive, HDFS, Apache Spark, Scala Google Cloud Platform (GCP) Jenkins, Airflow, SQL Experience with PostgreSQL or equivalent databases Strong understanding of application logic and code-level development Automated testing and CI/CD deployment practices Team collaboration in global environments Exposure to Enterprise Data Warehouse technologies Version control tools (Git, GitHub), deployment tools (Ansible), JIRA Agile methodologies (Scrum, Kanban) Creating an inspiring place to thrive for the talented, we use their expertise and courage to introduce the technology of the future into your business. - This is the foundation of Mindbox and the goal of our business and technology journey. We operate and develop in four areas: 🤖 Autonomous Enterprise - automation of business processes using RPA, OCR, and AI. 🌐Business Managment Systems ERP - we implement, adapt, optimize, and maintain flexible, safe, and open ERP of production and distribution companies worldwide. 🤝Talent Network - we provide access to the best specialists. ☁️ Modern Architecture - we build integrated, sustainable, and open CI / CD environments based on containers enabling safe and more frequent delivery of proven changes in the application code. We treat technology as a tool to achieve a goal. Thanks to our consultants' reliability and proactive approach, initial projects usually become long-term cooperation. For over 16 years, it has provided various services to support clients in digital transformation. #LI-Hybrid We offer: We are open to the employment form according to your preferences  Work with experienced and engaged team, willing to learn, share knowledge and open for growth and new ideas  Hybrid working system - 2 days a week from the office in Kraków Mindbox is a dynamically growing IT company, but still not a large one – everybody can have a real impact on where we are going next We invest in developing skills and abilities of our employees We have attractive benefits and provide all the tools required for work f.e. computer Interpolska Health Care, Multisport, Warta Insurance, training platform (Sages)  ,[Design and implement robust data ingestion pipelines using Spark (Scala), Orchestrate workflows with Airflow and deploy via Jenkins CI/CD, Collaborate in multidisciplinary teams (analysts, engineers, architects), Operate across private GCP and on-premises Hadoop environments, Translate business logic and PoC designs into scalable data solutions, Debug code issues and communicate findings to development teams, Contribute to ESG data asset creation for internal bank consumption] Requirements: Hadoop, Hive, HDFS, Spark, Scala, Google Cloud Platform, Jenkins, Airflow, SQL, PostgreSQL, Automated testing, CD, Data warehouse, Git, GitHub, Ansible, Jira Tools: Agile, Scrum, Kanban. Additionally: Sport subscription, Private healthcare, International projects, Free coffee.

  • Senior Data Engineer

    2 weeks ago

    Kraków, Czech Republic ELEKS Full time

    REQUIREMENTS 5+ years of commercial experience as a Data Engineer Strong expertise in AWS (particularly within the stack mentioned above) Focus on data processing Upper-Intermediate or higher level of English ELEKS Software Engineering & Development Office is looking for a Senior Data Engineer (AWS) in Poland or Ukraine. ABOUT PROJECT The platform replaces...

  • Senior Data Engineer @ HSBC Technology Poland

    1 week ago

    Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role Excellent experience in the Data Engineering Lifecycle. You will have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Senior stakeholder management skills.  Experience of modern Software Engineering principles and experience of creating well...

  • Data Engineer @ Mindbox Sp.z.o.o.

    21 hours ago

    Kraków, Czech Republic Mindbox Sp.z.o.o. Full time

    Experience of data engineering, ETL processes At least 7 years of professional experience in SQL development Experience in GCP, Big Query Experience with data build tools (DBT) Experience with Airflow, Cloud Composer Experience of data modelling Experience with data streaming, e.g. Kafka Experience with BI tools – mainly Looker Studio Experience making...

  • Big Data Engineer @ ITDS

    1 week ago

    Kraków, Czech Republic ITDS Full time

    You're ideal for this role if you have: A degree in Computer Science, IT, or a related discipline  Proven experience in designing and developing big data systems  Hands-on experience with Spark and distributed computing  Solid Java, Python, and Groovy development skills  Strong knowledge of the Spring ecosystem (Boot, Batch, Cloud)  Familiarity with...

  • Data Engineer with Python @ GFT Poland

    7 days ago

    Poznan, Warszawa, Wrocław, Łódź, Kraków, Czech Republic GFT Poland Full time

    Openness to work in a hybrid model (2 days from the office per week) At least 2 years of commercial experience as a Data Engineer Strong SQL and Python and Spark/PySpark Good understanding of Data Warehousing concepts Experience with Data Modelling Understanding of key concepts around Data Warehousing, Data Lakes and Data Lakehouses Experience with Cloud...

  • Senior Data Engineer

    21 hours ago

    Remote, Warszawa, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you’ll need to succeed in this role: At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes. Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. Hands-on with Big Data technologies like Spark, Cloudera, Data Platform,...

  • Senior Data Engineer/ Senior Data Platform Engineer @ Ocado Technology

    7 days ago

    Kraków, Czech Republic Ocado Technology Full time

    A proven track record of delivering scalable, reliable data engineering solutions using modern cloud-native tools and workflows (e.g. dbt, Airflow, Terraform). Strong communication and stakeholder collaboration skills, with the ability to work across engineering, product, and data functions. A pragmatic, delivery-focused mindset with a deep appreciation for...

  • Data Engineer Hadoop @ Antal

    1 week ago

    Kraków, Czech Republic Antal Full time

    Must-have qualifications: Minimum 5 years of experience as a Data Engineer / Big Data Engineer Hands-on expertise in Hadoop, Hive, HDFS, Apache Spark, Scala, SQL Solid experience with GCP and services like BigQuery, Dataflow, DataProc, Pub/Sub, Composer (Airflow) Experience with CI/CD processes and DevOps tools: Jenkins, GitHub, Ansible Strong data...

  • Senior Data Engineer @ HSBC Technology Poland

    1 week ago

    Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role Proven (3+ years) hands on experience in SQL querying and optimization of complex queries/transformation in BigQuery, with a focus on cost, time-effective SQL coding and concurrency/data integrity Proven (3+ years) hands on experience in SQL Data Transformation/ETL/ELT pipelines development, testing and...

  • Lead Data Engineer @ Kingfisher

    3 days ago

    Kraków, Czech Republic Kingfisher Full time

    Skills and Experience  Strong engineering background and proven experience in developing and maintaining large-scale distributed data processing systems or equivalent expertise. Extensive knowledge of data modelling principles, data quality assurance, testing methodologies, and best practices for data access and storage. Strong command of data scripting...