Data Engineer
11 hours ago
We are looking for Data Engineers for the data projects of our Fortune50 client. The main objective of the project is to modernize client's data infrastructure by migrating to Databricks. The solution is a cloud-based solution designed to empower users to build datasets for their projects in a swift, efficient, and standardized manner. The plan is for the data to power the GenAI in the future.
This is a remote-first position for engineers based in Europe, Turkey, and Middle East with a required overlap of US working hours (2-6 PM CET).
ResponsibilitiesData Modeling & ETL DevelopmentMigration of data infrastructure to Databricks
Transition to DBXaaS
Design data models.
Develop SQL code to define data structures and transform data from staging to marts.
Create Source to Target Mappings (STMs) for ETL specifications.
Evaluate data sources, assess quality, and determine the best integration approach.
Develop strategies for integrating data from various sources and data warehouses.
Optimize and maintain the data pipeline for SDCM, ECM, and DCM, flattening JSON into Databricks tables.
Work with data vault modeling (a plus).
Implement changes to the JSON flattening process based on business needs.
Write and execute unit tests to ensure code accuracy.
Optimize the performance of the data pipeline and fix data quality issues.
Implement active monitoring for both data pipelines and data quality.
Gather requirements, set targets, define interface specifications, and conduct design sessions.
Work closely with data consumers to ensure proper integration.
Adapt and learn in a fast-paced project environment.
Start Date: ASAP
Location: Remote
Working hours: US time zone overlap required: 2-6pm CET
Long-term contract based-role: 6+month
Strong Spark and SQL skills for ETL, data modeling, and performance tuning.
Experience with Databricks
Proficiency in Python, especially for handling and flattening complex JSON structures.
Hands-on experience with Cloud architecture (Azure - preferred, AWS, GCP).
Familiarity with Delta Lake and data warehousing concepts.
Experience with Azure Data Factory, Azure Cosmos DB, Azure functions, Event store, ADLS, Key Vault.
Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
Understanding of software engineering and testing practices within an Agile environment.
Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must have) and Kubernetes (plus).
Excellent teamwork and communication skills.
Proficiency in English, with strong written and verbal communication skills.
Efficient, high-performance data pipelines for real-time and batch data processing.
Knowledge of cryptography and its application in blockchain is a plus.
Experience with blockchain indexing is a plus.
Familiarity with Delta Lake and data warehousing concepts is a plus.
Your application has been successfully submitted
Other jobs-
Data Engineer
11 hours ago
Prague, Hlavní město Praha, Czech Republic DataSentics Full time 60,000 - 120,000 per yearWe're Hiring: Data Engineer at DataSentics (Part-Time or Full-Time)Do you enjoy solving data challenges using Python or SQL? Are you passionate about modern open-source tech and working in cloud environments? If you're eager to collaborate with experienced professionals and build impactful data solutions, we'd love to hear from you.What You'll DoAs a Data...
-
Data Engineer
11 hours ago
Prague, Hlavní město Praha, Czech Republic Oddin Full time 60,000 - 120,000 per yearWe're building a Realtime Data Platform – a platform that ingests data from multiple external sources, normalizes it into canonical models, and serves it for analytics, dashboards, and client-facing reports. As a BI Data Engineer, you'll design and operate data models and transformation pipelines, ensure data quality and reliability for...
-
Data Engineer
2 weeks ago
Prague, Hlavní město Praha, Czech Republic Oddin Full time 60,000 - 120,000 per yearAbout the RoleWe're building a Realtime Data Platform – a platform that ingests data from multiple external sources, normalizes it into canonical models, and serves it for analytics, dashboards, and client-facing reports.As a BI Data Engineer, you'll design and operate data models and transformation pipelines, ensure data quality and reliability for...
-
Data Engineer
1 week ago
Prague, Hlavní město Praha, Czech Republic Pure Storage Full time 80,000 - 120,000 per yearWe're in an unbelievably exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along with us, and join the smartest team in the industry.This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and...
-
Palantir Data Engineer
11 hours ago
Prague, Hlavní město Praha, Czech Republic Joyful Craftsmen AG Full time 120,000 - 180,000 per yearJob description Job Summary:We are looking for a Palantir Data Engineer to join our data engineering team We are seeking someone with experience in Palantir Foundry and PySpark or Python. In this role, you will design, develop, and maintain complex data pipelines, optimize data workflows within the Palantir platform, and collaborate closely with...
-
Senior Data Engineer
1 week ago
Prague, Hlavní město Praha, Czech Republic Mastercard Full time 90,000 - 120,000 per yearJob Title:Senior Data Engineer Overview:Overview: Mastercard's Test & Learn team is seeking a Senior Data Engineer to contribute to the data management aspects of client engagements, delivering Test & Learn and other innovative solutions within the Services group. In this role, you will develop robust data pipelines, implement scalable data solutions, and...
-
Senior Data Engineer
1 week ago
Prague, Hlavní město Praha, Czech Republic Microsoft Full time 900,000 - 1,200,000 per yearAs a Senior Data Engineer, you will design and deliver scalable, secure, and high-performance data solutions that power intelligent experiences across our ecosystem. This role sits at the intersection of software engineering and data innovation, requiring deep expertise in distributed systems, data modeling, and modern data processing frameworks. You will...
-
Data Engineer/Data Steward
1 week ago
Prague, Hlavní město Praha, Czech Republic Wargaming Full time 90,000 - 120,000 per yearJob OverviewWargaming is looking to hire a proactive, passionate, and goal-oriented Data Engineer/Data Steward possessing deep technical knowledge on high-load telemetry systems creation and operation along with project management skills necessary for keeping the World of Tanks data storage, transfer, and usage efficient.We gather various types of...
-
Data Engineer
4 days ago
Prague, Hlavní město Praha, Czech Republic NN GROUP Full time 90,000 - 120,000 per yearAt NN Group Finance & Risk, we work with vast and exponentially growing volumes of data. To transform this data into meaningful insights, it must be correct, accurate, complete, timely, and consistent. We are looking for an experienced Senior and Medior Data Engineers to help us build and manage data platforms on Azure, supporting investment operations,...
-
Network Support Engineer L2
1 week ago
Prague, Hlavní město Praha, Czech Republic NTT DATA Full time 40,000 - 80,000 per yearContinue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...