Senior Hadoop Specialist for Complex Data Processing
4 hours ago
We are looking for a skilled professional with expertise in managing and processing complex data using Hadoop technology. The ideal candidate will have experience working with Cloudera distribution and be proficient in Docker and Kubernetes platforms.
As a Senior Hadoop Specialist, you will be responsible for designing and implementing data pipelines, developing scalable data processing systems, and ensuring data quality and integrity. You will work closely with cross-functional teams to identify business needs and develop solutions that meet those needs.
The successful candidate will have a strong background in Big Data technologies, including Spark and Scala, as well as experience working with relational databases such as Oracle. Additionally, they will have proficiency in Unix Shell scripting and be familiar with workflow schedulers like Oozie. Experience with Elasticsearch clusters is a plus.
We are open to candidates who have completed the Quantexa Academy certification or have worked on Quantexa projects in the past. If you have a passion for working with complex data and are looking for a challenging role, we encourage you to apply.
This position offers a unique opportunity to work on various projects within the Banking industry, with a focus on hybrid working arrangements. Our team values independence, technical expertise, and collaboration, making this an exciting opportunity for the right candidate.
Key Responsibilities:- Design and implement data pipelines for complex data processing
- Develop scalable data processing systems using Hadoop and related technologies
- Ensure data quality and integrity through rigorous testing and validation
- Collaborate with cross-functional teams to identify business needs and develop solutions
- Experience working with Hadoop technology and Cloudera distribution
- Proficiency in Docker and Kubernetes platforms
- Strong background in Big Data technologies, including Spark and Scala
- Experience working with relational databases such as Oracle
- Proficiency in Unix Shell scripting
- Familiarity with workflow schedulers like Oozie
- Experience with Elasticsearch clusters (nice to have)
- Hybrid working arrangement with flexible schedules
- Opportunity to work on various projects within the Banking industry
- Collaborative and dynamic work environment
-
Senior Hadoop Developer
2 weeks ago
Warsaw, Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeJob Description:We are seeking a highly skilled Data Engineer to join our team at emagine Sp. Z o.o. as a Senior Hadoop Developer.This role is an excellent opportunity for someone who wants to work with cutting-edge technology and be part of a dynamic team that delivers complex data solutions.About the Role:As a Senior Hadoop Developer, you will design,...
-
Senior Big Data Developer for Banking Projects
4 weeks ago
Warsaw, Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeProject OverviewWe are seeking a highly skilled Senior Big Data Developer to join our team at emagine Sp. Z o.o. in Warsaw, Poland. As a Senior Big Data Developer, you will be responsible for designing and implementing complex data processing systems using Hadoop, Cloudera, Docker, Kubernetes, and other big data technologies.Salary InformationThe salary for...
-
Data Engineer
1 month ago
Warsaw, Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeNeeds to have experience in Hadoop Cloudera distribution. Needs to have experience in Docker/Kubernetes platforms. Needs to have experience in Oracle or any relational database. Should have experience in setting the CICD pipelines. Should be strong in Spark, Scala, Big data technologies. Should have experience in Unix Shell scripting. Good to have working...
-
Data Engineer for Big Data Processing
3 weeks ago
Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeAbout the Role:We are seeking an experienced Data Engineer to join our team at emagine Sp. Z o.o. as a Senior Data Engineer.Job Summary:The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing pipelines using Spark and Python.Key Responsibilities:Designing and implementing data ingestions and...
-
Senior Data Transformation Specialist
4 hours ago
Gdańsk, Gdynia, Warszawa, Łódź, Czech Republic AVENGA Full timeJob Title: Senior Data Transformation SpecialistAVENGA is looking for a highly skilled and experienced Senior Data Transformation Specialist to join our team.About the Role:We are seeking an expert in data transformation with strong SQL skills, Oracle knowledge, and experience with Extract-Transform-Load (ETL) processes and tools.The ideal candidate will...
-
Senior Data Automation Specialist
1 month ago
Gdańsk, Pomerania, Czech Republic emagine Sp. Z o.o. Full timeWe are looking for a skilled Senior Data Automation Specialist to join our team in Gdańsk. This is a long-term contract with a hybrid work model, requiring 1 day of presence at the office per week.The estimated salary for this position is up to 165 PLN/h netto + VAT. Industry: Banking. Rate: up to 165 PLN/h netto + VAT. Type of assignment: B2B. Project...
-
Senior Data Transformation Specialist
2 weeks ago
Gdańsk, Gdynia, Warszawa, Łódź, Czech Republic AVENGA Full timeAre you passionate about data transformation and working in a collaborative team environment? AVENGA is looking for a highly skilled Senior Data Transformation Specialist to join our team.About the RoleWe are seeking an experienced professional with a strong background in SQL, ETL processes, and testing. The ideal candidate will have 3+ years of experience...
-
Senior Data Engineer
1 week ago
Warszawa, Gdańsk, Gdynia, Czech Republic emagine Sp. Z o.o. Full timeJob Title: Senior Data Engineer - Banking Domain ExpertWe are seeking a highly skilled Senior Data Engineer to join our team at emagine Sp. Z o.o.About the JobIn this role, you will design, create, and maintain large-scale data applications using the Apache Spark framework, ensuring high-performance data processing and analytics.Key ResponsibilitiesDevelop...
-
Senior Data Engineer at Emagine
1 month ago
Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeJob TitleSenior Data Engineer at EmagineAbout UsWe are a leading company in the industry, and we're looking for a talented Senior Data Engineer to join our team. With a strong focus on innovation and collaboration, we strive to deliver cutting-edge solutions that exceed our clients' expectations.Salary and BenefitsWe offer an attractive salary of up to 180...
-
Experienced Data Architect
1 month ago
Warsaw, Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeJob Title: Experienced Data ArchitectWe are looking for a skilled Data Engineer to join our team at emagine Sp. Z o.o.About the Role:This position involves working with complex data systems and creating efficient solutions to meet business needs.About You:You have experience in Hadoop Cloudera distribution and Docker/Kubernetes platforms.You have experience...
-
Senior Data Engineer
7 days ago
Gdańsk, Pomerania, Czech Republic emagine Sp. Z o.o. Full timeAbout the Role:We are looking for a highly skilled Senior Data Engineer to join our team in Gdańsk. As a Senior Data Engineer, you will be responsible for designing and implementing solutions to meet business requirements using Scala and Spark.Key Responsibilities:Developing and maintaining large-scale data processing pipelines using Scala and...
-
Senior Data Transformation Specialist
4 weeks ago
Gdańsk, Gdynia, Warszawa, Łódź, Czech Republic AVENGA Full timeWe are seeking a highly skilled Senior Data Transformation Specialist to join our team at AVENGA.The ideal candidate will have extensive experience in ETL testing, SQL, and big data technologies. They will work closely with developers, analysts, and business stakeholders to understand the transformation process and create effective testing SQLs.A key...
-
Warsaw, Gdynia, Gdańsk, Łódź, Czech Republic emagine Sp. Z o.o. Full timeJob OverviewAs a key member of our Information Factory team at emagine Sp. Z o.o., you will play a pivotal role in expanding our Data Lake and building robust data capabilities through automation. This is an exciting opportunity to leverage your technical expertise in test automation and contribute to the development of innovative solutions.About the RoleWe...
-
Data Engineer
2 weeks ago
Warsaw, Gdynia, Gdańsk, Łódź, Czech Republic emagine Sp. Z o.o. Full timeWe are seeking a highly skilled Data Engineer to join our Information Factory team at emagine Sp. Z o.o. in Warsaw, Gdańsk, Gdynia, or Łódź.About the RoleAs a Data Engineer in our Information Factory team, you will be responsible for designing and implementing data pipelines using Hadoop Platform, Python, SQL, and Robot Framework. Your primary goal will...
-
Senior Data Analyst Power Developer
4 weeks ago
Gdansk, Gdynia, Czech Republic emagine Sp. Z o.o. Full timeAbout the RoleWe are seeking an experienced Senior Data Analyst Power Developer to join our team at emagine Sp. Z o.o. in Gdansk or Gdynia.Job DescriptionDevelop and maintain Power BI dashboards and reports using DAX, ensuring data accuracy and timely delivery of insights to stakeholders.Create and implement Power Apps solutions from concept to release,...
-
Remote, Gdynia, Warszawa, Poznań, Kraków, Wrocław, Czech Republic Idego Group Sp. z o.o. Full timeJob DescriptionThe Data Analyst Specialist for Complex Data Insights position at Idego Group Sp. z o.o. is designed for experienced professionals who excel in analyzing and interpreting complex data to drive business decisions.As a key member of our team, you will work on high-profile projects with clients worldwide, leveraging your expertise in data...
-
Senior Data Solutions Specialist
1 month ago
Remote, Warszawa, Łódź, Gdańsk, Gdynia, Czech Republic emagine Sp. Z o.o. Full timeJob DescriptionWe are seeking a highly skilled Senior Data Solutions Specialist to join our team in Warsaw, Łódź, Gdańsk, or Gdynia. This is a long-term contract opportunity with a competitive salary of up to 145 zl/h net + VAT.About the Role:Design and implement near real-time payment data flows, including data integrations and data mapping.Collaborate...
-
Gdańsk, Pomerania, Czech Republic emagine Sp. Z o.o. Full timeWe are looking for a skilled Scala developer to join our team at emagine Sp. Z o.o.About the JobThis is an exciting opportunity to work on a project that involves developing and maintaining complex data processing systems using the Scala programming language and the Apache Spark framework.The ideal candidate will have a strong background in software...
-
Warsaw, Gdańsk, Gdynia, Lodz, Czech Republic emagine Sp. Z o.o. Full timeWe are seeking experienced Data Engineers with expertise in the Quantexa platform to join our team at emagine Sp. Z o.o.About the RoleThis position involves working on technically complex projects, solving advanced problems independently, and leveraging cutting-edge tools and technologies.Key ResponsibilitiesDesign, develop, and maintain data pipelines and...
-
Senior Data Engineer @ emagine Sp. Z o.o.
2 months ago
Gdynia, Gdańsk, Czech Republic emagine Sp. Z o.o. Full timeDescription of knowledge and experience: 4+ years of experience as Data Engineer. Experience in Spark and Python Strong understanding Spark SQL or Hive SQL. Experience with Hadoop/Hive ecosystem or other Big Data technologies. Previous experience in creating data flows. Experience with BitBucket and GIT, code versioning and branching...