Senior Data Engineer

6 days ago

Remote Kraków, Czech Republic N-iX Full time
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or related fields.
  • 3+ years of experience in developing and deploying data services for HPC or similar systems.
  • Proven expertise with HDF5 or similar, in parallel I/O operations. Equivalent experience in distributed systems is also applicable.
  • Programming: Strong proficiency in (at least one): C++, Python, GoLang, or Fortran.
  • HDF5 Expertise: In-depth knowledge of HDF5 APIs and advanced features like parallel HDF5.
  • Parallel I/O: Experience with MPI I/O, POSIX I/O, or similar frameworks for concurrent/parallel data access.
  • Performance Optimization: Skills in profiling and optimizing I/O operations for large datasets.
  • Proficiency in SQL and experience with any RDMS
  • Might be a plus: knowledge of at least one orchestration and scheduling tool, for example, Airflow, Prefect, Dagster, etc.
  • Strong problem-solving skills and ability to work in a multidisciplinary team.
  • Excellent communication skills for cross-team collaboration and documentation.

Preferred Qualifications:

  • Familiarity with data formats used in scientific computing, 3D visualization, and simulation workflows.

About our customer:

Our client is a global company specializing in software development and consulting who combines science and technology with deep industry expertise to solve complex subsurface and surface challenges in the evolving energy sector.
The client headquartered is located in Canada, with offices around the world. The company serves organizations globally, providing cutting-edge software technology and unparalleled customer support.

Key Software Solutions:
Our client offers a range of reservoir simulation software, including:

  • IMEX – A black oil simulator for primary, secondary, and tertiary recovery processes.
  • GEM – An advanced simulator for compositional, chemical, and unconventional reservoir modeling.
  • STARS – The industry standard for thermal and advanced recovery processes.
  • CMOST – An intelligent optimization and analysis tool that integrates statistical analysis, machine learning, and unbiased data interpretation to determine optimal reservoir solutions.

The company invests in research and development, continuously improving its products and delivering state-of-the-art solutions for energy modeling and optimization.

About the Role:

We are looking for an experienced Data Service Module Engineer to develop and deploy the data service module for the HPC modeling project. This role focuses on implementing high-performance data storage and retrieval systems using HDF5 or similar, with parallel and concurrent I/O capabilities. The ideal candidate will have expertise in designing scalable data services optimized for HPC or distributed workflows, ensuring low latency and high throughput.

,[Design and implement the data service module using HDF5 for efficient data storage and retrieval., Develop parallel and concurrent I/O mechanisms to optimize performance for large-scale datasets., Ensure the module is tightly integrated with HPC and visualization workflows., Optimize I/O operations for CPU/GPU-based workflows to minimize bottlenecks., Implement caching, compression, and other strategies to enhance performance., Design data structures and schemas suitable for storing 3D grid data and other simulation outputs., Ensure data integrity and consistency during concurrent read/write operations., Develop and execute test cases to validate module performance and reliability under various load conditions., Conduct benchmarking to ensure scalability across different hardware configurations., Document the architecture, APIs, and usage guidelines for the data service module., Provide technical support to the development and visualization teams for data integration.] Requirements: JS, HTML, CSS, Oracle19, Python, C++, Golang, HDF5, HPC, SQL, Airflow Tools: . Additionally: International projects, Training budget, Competition of certification, Tech community, Free coffee, Modern office, kitchen.

  • Senior Data Engineering Specialist

    3 days ago

    Remote, Kraków, Czech Republic N-iX Full time

    We are seeking a proactive Senior Data Engineer to join our vibrant team at N-iX. In this role, you will collaborate closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry.Key ResponsibilitiesDesign, Implement, and Maintain Scalable Data Pipelines:...

  • Senior Data Engineer @

    26 minutes ago

    Remote, Warsaw, Kraków, Wrocław, Gdańsk, Czech Republic RemoDevs Full time

    4+ years of experience with Python Proven expertise in Databricks and data pipeline development Strong skills in SQL for data processing and transformation Proficiency with cloud platforms (preferably Azure) Fluent English communication skills Senior Data EngineerAre you passionate about turning raw data into meaningful insights? Do you thrive in a...

  • Senior Data Engineer @

    26 minutes ago

    Remote, Kraków, Czech Republic Altimetrik Poland Full time

    And if you possess..Extensive experience designing, building, and operating robust distributed data platforms (e.g., Spark, Kafka, Flink) and handling data at the petabyte scale.Strong knowledge of Java, Scala, or Python, and expertise with data processing technologies and query authoring (SQL).Expertise in data modeling, warehousing, and working with...

  • Senior Data Engineer @

    4 days ago

    Remote, Kraków, Czech Republic Appliscale Full time

    Required: Minimum of 5 years commercial work experienceBachelor's or higher degree in Computer Science, Software Engineering, or a related fieldProficiency in Python, essential for data processing and analysis tasksHands-on experience with DBT (Data Build Tool)Commercial experience using PySpark and DatabricksKnowledge in Infrastructure as Code tooling,...

  • Strong Middle Data Engineer @

    3 days ago

    Remote, Kraków, Czech Republic N-iX Full time

    4+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industryProven experience as a Data Engineer with a focus on cloud-based solutions.Strong proficiency in Python, and PySparkHands-on experience with Azure cloud servicesExpertise in data modeling, database design, and optimization.Familiarity with Big Data...

  • Senior SQL Data Engineer with Azure

    6 days ago

    Remote, Wrocław, Warszawa, Kraków, Poznań, Katowice, Czech Republic DataRiseLab Full time

    Experience:4+ years of experience in Data Engineering Experience in Microsoft Azure Data ecosystem (i.e. Azure Data Factory, Azure SQL and Synapse Analytics, Data Bricks) Experience with data modelling and data integration Knowledge in SQL (T-SQL or any other) Problem-solving, analytical and critical thinking skills Experience with Agile and Scrum...

  • Senior Data Engineer @

    2 days ago

    Remote, Czech Republic 7N Sp. z o.o. Full time

    Bachelor's degree in computer science, engineering, or a related field, complemented by a minimum of 5 years of experience in data engineering. A master's degree is preferred.Extensive experience with git and managing version control in a collaborative environment.Proven track record of implementing and managing CI/CD pipelines.Strong proficiency in with...

  • Senior Data Engineer

    4 days ago

    Remote, Kraków, Czech Republic Appliscale Full time

    Company Overview:The company is one of the largest game studios known for their successful MOBA and FPS franchises.The Data Team collects and uses data to improve the player's experience, with a mission to harness the power of data for player-centric decisions and AI/ML products.As a core contributor, you will build robust data solutions capable of...

  • Senior Big Data Engineer

    4 days ago

    Remote, Czech Republic Adaptiq Full time

    At least 5 years of experience in Data Engineering domainAt least 2 years of experience with GoLangProficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databasesExperienced with big data tools such as Spark or Flink to enhance system performance and scalabilityProven experience with Kubernetes (K8S) and familiarity with GTP tools to ensure...

  • Lead Data Engineer @

    5 days ago

    Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this roleDemonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Experience with Python, Spark, SQL, Databricks, Azure Function App, Azure DevOps and Terraform.Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory &...

  • Senior Data Engineer

    26 minutes ago

    Remote, Warszawa, Czech Republic Sunscrapers Full time

    What's important for us?At least 5+ years of professional experience in data-related role Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar Expertise in Python and SQL languages Experience with data warehouses (Snowflake) Experience with different types of database technologies (RDBMS, vector, graphs, document...

  • Senior Data Engineer

    26 minutes ago

    Remote, Warsaw, Czech Republic GetInData | Part of Xebia Full time

    Proficiency in a programming language like Python / Scala or JavaKnowledge of Lakehouse platforms - DatabricksExperience working with dbtFamiliarity with Version Control Systems, particularly GITExperience as a programmer and knowledge of software engineering, good principles, practices, and solutionsExtensive experience in Microsoft AzureKnowledge of at...

  • Data Engineer @

    5 days ago

    Remote, Warszawa, Czech Republic SquareOne Full time

    Required Skills & Qualifications:Previous experience as a data engineerTechnical expertise with data modeling techniques (Data Vault)Advanced expertise with ETL tools (Talend, Alteryx etc.)Advanced SQL programming experience, Python is a plusPrevious experience with agile methodologies in Software DevelopmentPrevious experience working with Data...

  • Data Engineer @

    3 days ago

    Remote, Warszawa, Czech Republic SquareOne Full time

    Required Skills & Qualifications:Previous experience as a data engineerTechnical expertise with data modeling techniques (Data Vault)Advanced expertise with ETL tools (Talend, Alteryx etc.)Advanced SQL programming experience, Python is a plusPrevious experience with agile methodologies in Software DevelopmentPrevious experience working with Data...

  • Senior Data Engineer

    5 days ago

    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...

  • Senior Data Engineer

    4 days ago

    Remote, Warsaw, Wrocław, Białystok, Kraków, Gdańsk, Czech Republic Addepto Full time

    What you'll need to succeed in this role:At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.Strong programming skills in Python: writing a clean code, OOP design.Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.Experience in designing and...

  • Lead Data Acquisition Engineer @

    5 days ago

    Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this roleProgramming experience in the following languages: PowerShell, Terraform, Python, Windows command prompt and object orientated programming languages.Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Understanding of hardware and software principles and storage technologies...

  • Cybersecurity Data Acquisition Engineer Position in Poland

    5 days ago

    Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    Welcome to HSBC Technology Poland, where we are seeking a highly skilled Cybersecurity Data Acquisition Engineer to join our team.This is a mid-senior technical role that requires hands-on delivery of data engineering, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big...

  • Senior Data Engineer

    26 minutes ago

    Remote, Warsaw, Warszawa, Czech Republic Sunscrapers Full time

    What's important for us?At least 7+ years of professional experience in data-related role Experience with infrastructure-as-code tools, like Terraform Proficiency in using Airflow Expertise in AWS stack and services (EC2, ELB, IAM, RDS, Route53, S3, and more) Proficiency in using Docker Expertise in Python and SQL languages Experience with data...

  • Senior Data Engineering Specialist for Google Cloud

    7 hours ago

    Remote, Wrocław, Gdańsk, Rzeszów, Czech Republic Xebia sp. z o.o. Full time

    Xebia sp. z o.o. is a leading digital solutions developer, partnering with top brands such as UPS, McLaren, Aviva, and Deloitte.We're passionate about Cloud-based solutions, having partnerships with AWS, Microsoft Azure, and Google Cloud Platform (GCP).As a Senior Data Engineering Specialist for Google Cloud, you'll be responsible for designing, building,...