Big Data Engineer

4 days ago


Kraków, Lesser Poland, Czech Republic Capco Poland Full time

Required Skills & Qualifications:

  • Hands-on experience with Google Cloud Platform (GCP), including BigQuery, GCS, and DataProc.
  • Strong proficiency in Python programming for data engineering tasks.
  • Proven experience working with SQL and NoSQL databases.
  • Solid understanding of building and maintaining data pipelines using APIs.
  • Knowledge of data pipeline orchestration and optimization techniques.
  • Experience working with large-scale data sets and cloud-based data storage systems.
  • Strong problem-solving abilities and a keen attention to detail.

Nice to Have:

  • Knowledge of PySpark for large-scale data processing.
  • Familiarity with data engineering best practices and emerging technologies.

*We are looking for Poland based candidate. 

Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent as we can and we believe that everyone brings something different to the table – so we'd love to know what makes you different. Such differences may mean we need to make changes to our process to allow you the best possible platform to succeed, and we are happy to cater to any reasonable adjustments you may require. You will find the section to let us know of these at the bottom of your application form or you can mention it directly to your recruiter at any stage and they will be happy to help.

Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.

We also are experts in Java, Python, Spring, Hadoop, Angular, React, Android, Google Cloud, Selenium, SQL, Docker, Kubernetes focused on development, automation, innovation, and long-term projects in financial services. In Capco, you can code, write, create, and live at your maximum capabilities without getting dull, tired, or foggy.

We are seeking a skilled and passionate Data Engineer to join our dynamic team. This is an exciting opportunity for individuals with experience in building and managing data pipelines, and working with cloud technologies like Google Cloud Platform (GCP). If you're someone who thrives in a collaborative environment and enjoys problem-solving with cutting-edge tools, we'd love to meet you

BIG DATA ENGINEER @ CAPCO - WHAT TO EXPECT

  • You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry.
  • You'll be part of digital engineering team that develop new and enhance existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.
  • You'll be involved in digital and data transformation processes through a continuous delivery model.
  • You will work on automating and optimizing data engineering processes, develop robust and fault tolerant data solutions and enhancing security standards both on cloud and on-premise deployments.
  • You'll be able to work across different data, cloud and messaging technology stacks.
  • You'll have an opportunity to learn and work with specialized data and cloud technologies to widen the skill set.

WHY JOIN CAPCO?

  • Employment contract and/or Business to Business - whichever you prefer
  • Possibility to work remotely
  • Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
  • Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
  • Access to 3.000+ Business Courses Platform (Udemy)
  • Access to required IT equipment
  • Paid Referral Program
  • Participation in charity events e.g. Szlachetna Paczka
  • Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
  • Being part of the core squad focused on the growth of the Polish business unit
  • A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
  • A work culture focused on innovation and creating lasting value for our clients and employees

ONLINE RECRUITMENT PROCESS STEPS

  • Screening call with Recruiter
  • Technical interview
  • Meeting with Hiring Manager
  • Feedback/Offer
,[Design, implement, and manage scalable data pipelines using Google Cloud Platform (GCP)services, such as BigQuery,Google Cloud Storage (GCS), and DataProc., Build and optimize data workflows using SQL,NoSQL databases and APIs., Collaborate with cross-functional teams to gather requirements and ensure that data infrastructure supports the broader business objectives., Write efficient, maintainable code in Python for data processing and integration tasks., Troubleshoot and resolve issues related to data pipelines, databases, and cloud services., Ensure data quality, reliability, and security throughout the data pipeline lifecycle., Actively contribute to the design of new systems and maintain or upgrade existing data infrastructure., Contribute to security designs and have advanced knowledge of key security technologies e.g. TLS, OAuth, Encryption, Support internal Capco capabilities by sharing insight, experience] Requirements: Google Cloud Platform, Python, BigQuery, GCS, DataProc., Data engineering, SQL, NoSQL, APIS, Data pipelines, PySpark Additionally: Private healthcare, Employee referral bonus, MyBenefit, Udemy for business.

  • Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this roleDemonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Experience with Python, Spark, SQL, Databricks, Azure Function App, Azure DevOps and Terraform.Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory &...


  • Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    Welcome to HSBC Technology Poland, where we are seeking a highly skilled Cybersecurity Data Acquisition Engineer to join our team.This is a mid-senior technical role that requires hands-on delivery of data engineering, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big...


  • Kraków, Lesser Poland, Czech Republic Tesco Technology Full time

    About the RoleWe are looking for an experienced Machine Learning Engineer to join our growing Data Science Engineering team. As a key member of the team, you will work with engineers, data scientists, product managers, systems engineers, and analytics professionals to deliver valuable and innovative outcomes for our customers.You will be responsible for...


  • Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this roleProgramming experience in the following languages: PowerShell, Terraform, Python, Windows command prompt and object orientated programming languages.Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems)Understanding of hardware and software principles and storage technologies...


  • Kraków, Lesser Poland, Czech Republic HSBC Technology Poland Full time

    About the RoleWe are seeking an experienced Cybersecurity Data Engineer Leader to join our Platform & Data Engineering Team in HSBC Technology Poland. As a key member of our team, you will contribute to and coordinate data engineering, data acquisition, cloud infrastructure, platform operations, and production support activities using cutting-edge cloud and...

  • Data Engineer @

    4 days ago


    Kraków, Lesser Poland, Czech Republic Tesco Technology Full time

    QualificationsMandatory skills:Data Processing: Apache Spark - Scala or PythonData Storage: Apache HDFS or respective cloud alternativeResource Manager: Apache Yarn or respective cloud alternativeLakehouse: Apache Hive/Kyuubi or alternativeWorkflow Scheduler: Airflow or alternativeNice to have skills:Functional programmingApache KafkaKubernetesStream...


  • Kraków, Lesser Poland, Czech Republic Tesco Technology Full time

    You come from either a Software Engineering or ML Engineering background with a good understanding Programming (Python), Machine Learning and MLOps and bringing data science solutions into production.Key Requirements:4-5 years of experience working as a ML Engineer or Software Engineer or Python EngineerSearch and recommendation experience is desirable but...


  • Kraków, Lesser Poland, Czech Republic Reality Games Full time

    At least 2 years of experience in designing and building machine learning systemsStrong programming skills in Python or a similar languageAt least 1 year of experience with machine learning frameworks such as TensorFlow, PyTorch, or Scikit-learnExperience with Big Data technologies such as Apache Spark or HadoopExperience with cloud-based machine learning...


  • Kraków, Lesser Poland, Czech Republic Capco Poland Full time

    Capco Poland is a leading technology and management consultancy specializing in driving digital transformation across the financial services industry. Our team of experts helps clients succeed in an ever-changing industry.Job DescriptionWe are seeking a skilled Cloud Data Engineer to join our dynamic team. This exciting opportunity is for individuals with...

  • Data Scientist @

    6 days ago


    Kraków, Lesser Poland, Czech Republic Philip Morris Polska Distribution Spółka z o.o. Full time

    You have a master degree in Data Science, Computer Science, Statistics or a related field.3 + years of experience in a data science or related role.Proficient in at least one of the following languages: Python, R, SAS or Julia.Experience with big data technologies such as Sparks and a good grasp of machine learning framework such as TensorFlow or...

  • Software Engineer

    2 days ago


    Kraków, Lesser Poland, Czech Republic OpenX Full time

    4+ years experience with building SaaS applications using JavaScript/TypescriptExperience with React and Node.jsExperience with database system design, RDBMs, or NoSQLExperience with Google Cloud Platform or Amazon Web Services - nice to haveExperience working in digital media, marketing technology, or advertising technology is a big plusCommunicative Polish...


  • Kraków, Lesser Poland, Czech Republic OpenX Full time

    Requirements7+ years of similar position working experience in PythonBachelor's degree in Computer Science or an equivalent degreeExperience with database system design, RDBMs (MySQL, Postgres), or NoSQLExperience in GraphQLExcellent written and spoken English skillsExperience working in digital media, marketing technology, or advertising technology is a big...


  • Kraków, Lesser Poland, Czech Republic Remitly Poland sp. z o.o. Full time

    About UsAt Remitly, we're on a mission to transform the lives of immigrants and their families by providing the most trusted financial products and services on the planet.We're a leading digital payments company that's been delivering on our promises to immigrants sending money home since 2011.Today, we're reimagining international payments at scale and...


  • Kraków, Lesser Poland, Czech Republic VUMO Full time

    Requirements:- >5 years of experience supported by track of results in machine learning, with a strong focus on image processing techniques.- Proficiency in Python and ML frameworks (TensorFlow, PyTorch) and tools.- Strong data analytics skills and methodologies for long term maintanance of models.- Solid understanding of computer vision concepts and related...


  • Kraków, Lesser Poland, Czech Republic VUMO Full time

    At VUMO, we are a profitable Polish startup scaling our products globally. Our innovative car imaging solutions have paved the way for expanding our portfolio into vehicle inspection technology.We take pride in our highly interdisciplinary team of creative engineers, covering nearly all aspects of software and hardware development in-house. As a Senior...


  • Kraków, Lesser Poland, Czech Republic Keepit Full time

    About KeepitWe are a fast-growing company on a mission to secure the digital world by providing cloud-based backup services to customers worldwide.Our platform provides an immutable historical archive of primary data in various systems, protecting against ransomware and accidents.We use clean, modern C++ for our back-end components, Common Lisp for business...

  • Cloud Engineer

    2 days ago


    Kraków, Lesser Poland, Czech Republic Mindbox S.A. Full time

    Desired experience:Full development lifecycle (requirements, design, development, testing, data, infrastructure)Development in a large IT projectDevelopment in a Cloud project (preferably Google)Development in a Banking and/or Financial Crime Risk projectsTechnical skills:Experience with GCPBash/shell scripting & PythonLinux/UnixSQL, Databases (MySQL, Big...


  • Kraków, Lesser Poland, Czech Republic Antal Full time

    A Bachelor's degree in Mechanical Engineering, Mechatronics Engineering, or a related field is requiredA minimum of 3 years of relevant engineering experience is essential (in automotive or aviation industry)Fluency in English- at least B2/C1 levelExperience with EV Driveline and/or ICE Driveline systems is mandatoryProven expertise in creating and...


  • Kraków, Lesser Poland, Czech Republic ITDS Full time

    You're ideal for this role if you have:A BSc. in Computer Science or equivalent7+ years of experience with enterprise data systems, including data collection, processing, and analysisAt least 3 years of experience with Azure architecture and toolingStrong proficiency in MS SQL Server and Azure SQL databasesExperience with cloud and hybrid-cloud...


  • Kraków, Lesser Poland, Czech Republic Telenor Linx Polska Full time

    Excellence with Kotlin and Java programming languagesAvailability to drive and oversee software development initiativesPassion for software development and openness to other programming languages (Go, Python, Rust)Knowledge of REST and HTTP protocol, API design, and API securityKnowledge of SQL and database servers such as MySQL/PostgreSQLUnderstanding of...