AWS Data Engineer @ eConsulting
3 days ago
- Knowledge of English enabling work in an international team (level C1)
- Proven expertise in Hive Metastore and AWS Glue.
- Experience with metadata migration, including use of AWS Glue Crawlers and Hive Metastore Connectors.
- Strong knowledge of Hive partitioning, data formats (Parquet, ORC), and schema replication in Glue.
- Familiarity with AWS Athena, EMR, and other AWS data services.
- Proficiency in configuring AWS Glue security features such as IAM roles and Lake Formation.
- Experience in data quality monitoring, performance optimization, and cost management in AWS environments.
- Excellent troubleshooting skills with a focus on migration and post-migration processes.
- Effective communication and collaboration skills, particularly with data analysts and scientists.
About the Role:
We are seeking an experienced Data Migration & Integration Specialist with expertise in Hive and AWS Glue technologies. In this role, you will lead the migration, integration, and optimization of data systems in a cloud environment, ensuring seamless functionality and collaboration with analytics teams.
What do we offer?
- 100% remote work opportunity
- Hourly rate: 120-150zł/h+VAT depending on your experience
- Opportunity for long-term engagement and career development in cutting-edge data technologies.
- A range of various benefits (Multisport card, Medicover private medical care with access to the Damian Medical Center, group life insurance) provided after onboarding period
- Training and development aimed at upskilling
- One-of-a-kind team-building events, competitions and challenges
- Sports activities and language courses
Who are we?
eConsulting specializes in providing custom IT solutions designed for the digital era. Leveraging over 22 years of experience across various markets and industries, we specialize in life sciences, QA, validation, cloud systems, HCM, and Salesforce. Our expertise helps maximize revenue, reduce costs, and enhance operational quality in organizations. With hundreds of successful projects delivered globally, we are the go-to choice for top-quality GxP-focused IT services.
,[Lead the migration of metadata from Hive Metastore to AWS Glue Catalog, maintaining data consistency and integrity., Leverage AWS Glue Hive Metastore Connector and Glue Crawlers to automate metadata migration and table creation., Replicate Hive partitioning, data formats (e.g., Parquet, ORC), and schema to Glue, ensuring compatibility with AWS services like Athena and EMR., Collaborate closely with data analysts and scientists to enable seamless integration with data-driven analytics platforms., Configure and manage AWS Glue security, including IAM roles and Lake Formation, to ensure robust data access control and governance., Monitor data quality, performance, and cost efficiency in Glue and Athena, ensuring optimal query performance and cost management., Conduct thorough testing and validation of Glue Catalog migrations to guarantee data integrity and system functionality., Troubleshoot and resolve issues related to the migration process and post-migration data pipelines.] Requirements: AWS Glue, Hive Metastore Additionally: Sport subscription, Private healthcare, International projects.-
Data Migration Specialist
3 days ago
Remote, Czech Republic eConsulting Full timeAbout eConsulting:eConsulting is a leading provider of custom IT solutions designed for the digital era. With over 22 years of experience across various markets and industries, we specialize in life sciences, QA, validation, cloud systems, HCM, and Salesforce.Our expertise helps maximize revenue, reduce costs, and enhance operational quality in...
-
Middle/Senior Data Engineer
2 months ago
Remote, Czech Republic Provectus Full timeExperience in data engineering; Experience working with Cloud Solutions (preferably AWS, also GCP or Azure); Experience with Cloud Data Platforms (e.g., Snowflake, Databricks); Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation; Experience handling real-time and batch data flow and data warehousing with tools and...
-
Senior AWS Data Engineer @ Xebia sp. z o.o.
5 days ago
Remote, Wrocław, Gdańsk, Rzeszów, Czech Republic Xebia sp. z o.o. Full timeavailable to start immediately, readiness to work with the US Timezone (up to 9PM CET), 5+ years’ experience as a data engineer, 2+ years’ experience with AWS, strong SQL skills, Python scripting proficiency, hands-on experience in building data processing pipelines, experience in structuring and modelling data in both relational and non-relational...
-
Data Engineer with Cloud Expertise
4 weeks ago
Remote, Czech Republic Provectus Full timeWe are seeking a highly skilled Data Engineer to join Provectus' team of experts in AI consultancy and solutions. This role will involve collaborating with a multidisciplinary team to design, implement, and maintain scalable data pipelines using cloud-based technologies such as AWS, GCP, and Azure.Responsibilities:Collaborate closely with clients to...
-
AI/ML Engineer @ PAR Data Central
3 months ago
Remote, Czech Republic PAR Data Central Full timePosition Overview: As an AI/ML Engineer, you will play a crucial role in enhancing our platform’s capabilities by developing and refining machine learning models that drive accurate forecasting, event analysis, data-driven decision-making, and more. You will collaborate closely with product owners and engineering teams to implement scalable AI solutions...
-
Data Engineer for AI-Driven Data Solutions
2 weeks ago
Remote, Czech Republic Provectus Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team at Provectus. Our company is a leading AI consultancy and solutions provider, helping businesses achieve their objectives through innovative data-driven solutions.Company OverviewProvectus has been pioneering the use of AI in various industries, including healthcare and...
-
Remote, Wrocław, Gdańsk, Rzeszów, Czech Republic Xebia sp. z o.o. Full timeXebia sp. z o.o. is a leading digital solutions provider, renowned for its expertise in Cloud-based solutions.As a highly skilled Senior AWS Data Engineer at Xebia, you will play a crucial role in designing, building, and deploying scalable data processing systems, leveraging your expertise in distributed systems, Big Data, and Cloud technologies.This...
-
Data Engineer for Large-Scale Data Pipelines
1 week ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our Development Team at N-iX. As a key member of our team, you will design, develop, and optimize data pipelines within an AWS ecosystem.About the RoleDesign, develop, and implement data pipelines using PySpark within AWS environments.Leverage AWS services such as S3, Glue, EMR, Lambda, and...
-
Senior Data Engineer @ Sunscrapers
2 months ago
Remote, Warszawa, Czech Republic Sunscrapers Full timeAt least 5 years of professional experience as a data engineer, Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar, Excellent command in spoken and written English, at least C1, Strong professional experience with Python and SQL, Hands on experience on DBT and Snowflake, Experience in building data pipelines with...
-
Data Engineer for Scalable Data Solutions
1 month ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full timeWe are seeking an experienced Data Engineer to join our Development Team at N-iX, a US-based B2B marketplace company.About the RoleAs a Data Engineer on our team, you will design, develop, and optimize data pipelines within an AWS ecosystem. Your expertise in PySpark will be instrumental in processing large-scale datasets, ensuring the reliability and...
-
Remote, Budapest, Czech Republic IDBC Creative Solutions Kft. Full timeWe are seeking a seasoned Senior AWS DevOps and Infrastructure Engineer to join our Platform Engineering Team in Silicon Valley, California. As a key member of the team, you will be responsible for designing, building, and maintaining large-scale data and ML platforms, enabling end-to-end product development.Job OverviewAverage salary: $150,000 per yearThe...
-
Senior Data Engineer
3 weeks ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full timeWe are seeking a highly skilled Senior Data Engineer to join our Development Team at N-iX. As a key member of our team, you will play a critical role in designing and developing scalable data solutions using PySpark within an AWS ecosystem.Company OverviewN-iX is a US-based B2B marketplace company committed to delivering high-quality solutions that meet the...
-
Remote, Czech Republic N-iX Full timeJob DescriptionWe are seeking a skilled Middle-Senior Data Engineer to join our Technology Office in N-iX. The ideal candidate will have extensive experience in data engineering, with expertise in Databricks, DBT, and Python.About the RoleDesign and develop scalable data pipelines using Databricks, DBT, and Python.Collaborate with cross-functional teams to...
-
Data Warehouse Engineer
1 month ago
Remote, Wrocław, Warsaw, Cracow, Czech Republic Holisticon Connect Full timeYou might be the perfect match if you are/have: Bachelor’s or Master’s degree in Computer Science or a related field (or equivalent experience); 4+ years of experience in Data Warehouse development and support; 3+ years of experience with cloud technologies, preferably AWS, Snowflake, or Matillion; Advanced knowledge of SQL and relational...
-
AI/ML Engineer for Data-Driven Solutions
6 days ago
Remote, Czech Republic PAR Data Central Full timeAbout PAR Data CentralWe are a leading restaurant technology provider to the world's top restaurant brands, dedicated to building innovative solutions that connect people to the restaurants, meals, and moments they love.As a pioneer in the industry, we've invented game-changing technologies like the first point-of-sale terminal over 40 years ago. Today, our...
-
Data Engineer
3 weeks ago
Remote, Warszawa, Czech Republic Sunscrapers Full timeWe are looking for a Senior Data Engineer to join our team in Warsaw or remotely. This role is ideal for an experienced professional with a strong background in data engineering and a passion for building scalable data systems.Company OverviewSunscrapers is a leading force in software development, expanding its presence in the data-centric environment. We...
-
Data Engineer with Snowflake @ VirtusLab
1 week ago
Remote, Kraków, Kielce, Wrocław, Czech Republic VirtusLab Full timeStrong SQL skills Strong engineering skills Polyglot engineer with experience in traditional Data Engineering and a knowledge of current trends like Modern Data Stack Demonstrated ability of design, build and implementation of software solutions in Snowflake and dbt with an unwavering focus on quality Ability to work in an agile environment, partnering with...
-
Middle/Senior Data Engineer @ N-iX
1 month ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full timeBachelor’s degree in Computer Science, Engineering, or a related field 4 years+ of experience in data engineering, with a focus on building and optimizing data pipelines using PySpark Strong experience with AWS services, including S3, Glue, Lambda, EMR, and Redshift Proficiency in Python programming and familiarity with related frameworks and...
-
Senior Data Engineer @ N-iX
4 weeks ago
Remote, Gdynia, Wrocław, Gdańsk, Trójmiasto, Czech Republic N-iX Full timeAbout the project: Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Senior Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user...
-
Lead Data Engineer @ N-iX
4 weeks ago
Remote, Gdynia, Wrocław, Trójmiasto, Gdańsk, Czech Republic N-iX Full timeAbout the project: Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user...