Big Data Solutions Architect

3 days ago


Warszawa, Mazovia, Czech Republic Capco Poland Full time

We are seeking a highly skilled and motivated Big Data Administrator/Engineer with 5+ years of experience in Hadoop administration and expertise in automation tools like Ansible, Shell scripting, or Python scripting.

Key Responsibilities
  • Hadoop Cluster Administration: Administer and manage Hadoop clusters, ensuring high availability, performance, and scalability.
  • Maintenance and Troubleshooting: Maintain and troubleshoot Hadoop ecosystem components such as HDFS, MapReduce, YARN, and related tools.
  • Kafka, HBase, and Spark Optimization: Ensure Kafka, HBase, and Spark systems are optimized and running smoothly.
  • Monitoring and Alerting: Implement monitoring and alerting for Big Data infrastructure.
Automation and Scripting
  • Script Development: Develop and automate scripts using tools such as Ansible, Shell scripting, or Python to streamline Big Data administration tasks.
  • Automation Frameworks: Create reusable automation frameworks to reduce manual efforts and improve operational efficiency.
  • CICD Pipelines: Work on CI/CD pipelines for deployment automation and system integration.
DevOps Practices
  • Continuous Integration: Apply DevOps principles to the Big Data environment, focusing on continuous integration and continuous delivery (CI/CD).
  • Automated Deployment: Build and manage automated deployment processes for Big Data clusters and services.
  • Collaboration: Collaborate with development teams to integrate automation in Big Data workflows.
Troubleshooting and Debugging
  • Issue Identification: Identify, troubleshoot, and resolve issues related to Big Data platforms, including system performance, resource utilization, and service failures.
  • Debugging Techniques: Work with logs, monitoring tools, and other debugging techniques to diagnose and resolve complex issues.
Collaboration and Support
  • Team Collaboration: Work closely with other teams to support data pipelines, data quality checks, and performance optimizations.
  • Ongoing Support: Provide ongoing technical support to ensure that Big Data systems are stable, secure, and aligned with business objectives.


  • Warszawa, Mazovia, Czech Republic Capco Poland Full time

    Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.We also are experts in Java, Python, Spring, Hadoop, Angular, React, Android, Google Cloud, Selenium, SQL, Docker, Kubernetes...


  • Warszawa, Mazovia, Czech Republic Quontex Ltd Full time

    Quontex Ltd is a leading programmatic media company specializing in large-scale data processing and insights. Among their esteemed clients are renowned brands such as Walmart, Barclaycard, and Ford.The company has expanded significantly with over 700 employees across four continents and 15 global offices. With the opening of a new office in Warsaw, they seek...


  • Warszawa, Mazovia, Czech Republic SambaTV Full time

    Transform the Viewing ExperienceSamba TV tracks streaming and broadcast video across the world with our proprietary data and technology. We are on a mission to fundamentally transform the viewing experience for everyone.As a leader in data engineering, you will be responsible for designing and implementing scalable, high-performance data pipelines that power...


  • Warszawa, Mazovia, Czech Republic UL Solutions Full time

    About the RoleWe are seeking a highly skilled Chief Data Systems Architect to join our Enterprise Data Management & Analytics team at UL Solutions. As a key member of our team, you will play a vital role in designing, implementing, and optimizing data models to support our business analytics and reporting needs.Key ResponsibilitiesData Model DesignTranslate...


  • Warszawa, Mazovia, Czech Republic Reckitt Full time

    Job OverviewWe are seeking a highly skilled SAP Data Platform Architect to lead our global transformation initiatives. As a key member of our team, you will be responsible for designing and implementing advanced data migration solutions across SAP modules.


  • Warszawa, Mazovia, Czech Republic dotData Full time

    Company Overview:dotData is a leader in automating data science, and we're seeking a skilled Data Scientist to join our team.Salary:Competitive SalaryJob Description:We're looking for a customer-facing Data Scientist who can work directly with clients to solve complex problems using our products. The ideal candidate will have strong communication skills, be...


  • Warszawa, Mazovia, Czech Republic Netcompany Full time

    Company Overview">Netcompany is a leading international IT company with over 8200 employees working from more than 10 locations. We serve a wide range of customers in their digital transformation journeys in public and private sectors across Europe.">Job Description">We are looking for a Senior Dataverse Developer/Architect to join our international teams...


  • Warszawa, Mazovia, Czech Republic Ework Group Full time

    About Ework GroupEwork Group is a leading provider of IT and cloud-based solutions. We're passionate about empowering businesses to thrive in the digital age.Job SummaryWe're seeking an experienced Cloud Engineer to join our team. As a Cloud Engineer, you will be responsible for designing, developing, and maintaining cloud-native applications and services on...


  • Warszawa, Mazovia, Czech Republic T-Mobile Polska Full time

    Job DescriptionWe are looking for a Data Platforms Technical Lead to oversee the design, development, and management of T-Mobile's data platforms infrastructure.About UsT-Mobile Polska is a leading telecommunications company that offers a wide range of services to its customers.Key Responsibilities:Leadership Role: Oversee and mentor a team of data engineers...


  • Warszawa, Mazovia, Czech Republic Capco Poland Full time

    Company OverviewCapco Poland is a leading technology and management consultancy specializing in driving digital transformation across the financial services industry.We are passionate about helping our clients succeed in an ever-changing industry with innovative solutions and expert knowledge.Skill RequirementsStrong cloud provider experience on Google Cloud...


  • Warszawa, Mazovia, Czech Republic UL Solutions Full time

    About the RoleAs a seasoned IT professional, you will be responsible for designing, developing, testing, and deploying applications using Azure technologies and services.You will collaborate with cross-functional teams to ensure applications meet business requirements and integrate Azure services such as Azure Functions, Azure Logic Apps, Azure Event Grid,...


  • Warszawa, Mazovia, Czech Republic Beesafe Full time

    About BeesafeWe are a dynamic team driving digital innovation in the insurance and eCommerce sectors. Our hybrid working model supports both collaborative office work and flexible remote work, allowing us to redefine the rules in the insurance industry with our innovative approach.About the RoleWe're seeking passionate Data Engineers, both at mid and senior...

  • Data Architect

    5 days ago


    Warszawa, Mazovia, Czech Republic Tylko Full time

    We are seeking an experienced Data Engineer to join our team, responsible for designing and implementing a business-facing data warehouse that supports our company's commitment to analytics.Key Responsibilities:Data Warehouse Design: Design and build a healthy, scalable architecture for real-time and batch data processing in BigQuery.ETL Pipelines: Construct...


  • Warszawa, Mazovia, Czech Republic SambaTV Full time

    Unlock the Power of Data with Samba TVSamba TV is a pioneering company that revolutionizes the viewing experience with our proprietary data and technology. We are on a mission to fundamentally transform the way media companies connect with audiences and advertisers engage viewers.We're seeking a highly skilled Senior Data Scientist to drive advanced...


  • Warszawa, Mazovia, Czech Republic Link Group Full time

    Link Group: A Leading Consulting FirmWe are a renowned consulting firm with extensive experience in implementing innovative solutions for our clients. As a seasoned professional, you will have the opportunity to work with senior experts to design and develop cutting-edge Salesforce applications.About the RoleThis is an exciting opportunity for a skilled...


  • Warszawa, Mazovia, Czech Republic Devire Full time

    About Devire IT OutsourcingDevire IT Outsourcing is a business-to-business cooperation platform dedicated to IT professionals. We implement projects for clients running innovative and modern projects.We are working with a global leader in AI-driven financial solutions, expanding their tech hub in Poland and seeking a highly skilled Senior Python Engineer...


  • Warszawa, Mazovia, Czech Republic Devire Full time

    Devire IT Outsourcing is a form of cooperation dedicated to IT professionals, based on the principles of own business - B2B, implementing projects for clients running innovative and modern projects.We are developing a technology center in Poland and looking for a Senior Data Engineer to join our team. This position is perfect for someone who wants to work...


  • Warszawa, Mazovia, Czech Republic Digital Hub Warsaw at Bayer Full time

    About Us:Digital Hub Warsaw at Bayer is a dynamic and inclusive environment where creative minds come together to develop innovative solutions that align with our vision of "Health for all - Hunger for none."We are looking for a talented Software Engineer in Training to join our team and contribute to the development of groundbreaking projects in Data...


  • Warszawa, Mazovia, Czech Republic Goldman Recruitment Full time

    Company OverviewOur client is a global leader in the FMCG industry with an office located in Warsaw. We are looking for candidates interested in the position of Master Data Team Leader.


  • Warszawa, Mazovia, Czech Republic Ringier Axel Springer Tech Full time

    We are developing cutting-edge, cloud-native solutions, including an automation and personalization platform, data-as-a-service product, and a natural language understanding engine. Our Mission:To transform how media industry clients operateAbout the Role:You will be responsible for independently leading the frontend side of the project, ensuring seamless...