Data Engineer @ HSBC Technology Poland

1 day ago


Kraków, Czech Republic HSBC Technology Poland Full time
  • Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, Sparkstreaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).
  •  Sound knowledge on working Unix/Linux Platform.
  •  Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.
  •  Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible& Jenkins) and requirement management in JIRA.
  • Understanding of big data modelling techniques using relational and non-relational techniques.
  •  Experience on Debugging the Code issues and then publishing the highlighted differences to thedevelopment team/Architects.
  • Experience with: time-series/analytics dB’s such as Elastic search, scheduling tools such as Airflow,Control-M, understanding of Cloud design patterns, developing Hive QL, UDF’s for analysing semi structured/structured datasets.
  • Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.

Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
Your career opportunity

The Data Engineer will be responsible for designing, building, and managing the data infrastructure and data
pipeline processes for the bank. The ideal candidate will have a strong background in data engineering, excellent
leadership skills, and a thorough understanding of the banking industry's data requirements.

What we offer

  • Competitive salary
  • Annual performance-based bonus
  • Additional bonuses for recognition awards
  • Multisport card
  • Private medical care
  • Life insurance
  • One-time reimbursement of home office set-up (up to 800 PLN).
  • Corporate parties & events
  • CSR initiatives
  • Financial support with trainings and education
  • Nursery discounts
  • Social fund
  • Flexible working hours
  • Free parking
,[Spark development and design using Scala 2.10+ or Java development or Python development and design using Java 1.8+, automated testing of new and existing components in an Agile, DevOps anddynamic environment., Promote development standards, code reviews, mentoring, knowledge sharing. , Production support & troubleshooting., Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring, Liaison with BAs to ensure that requirements are correctly interpreted and implemented., Participate in regular planning and status meetings. Input to the development process – through theinvolvement in Sprint reviews and retrospectives. Input into system architecture and design., Peer code reviews.] Requirements: Apache Hadoop, Scala, Apache Spark, Yarn, Kafka, Hive, Python, ETL, SQL, REST API, Unix, Linux, Data pipelines, Hadoop, Spark, Spark SQL, Git, GitHub, Ansible, Jenkins, Jira, Big Data, Airflow, Control-M, Cloud, Design Patterns, Kanban Additionally: Training budget, Private healthcare, Flat structure, International projects, Multisport card, Monthly remote work subsidy, Psychological support, Conferences, PPK option, Annual performance based bonus, Integration budget, International environment, Small teams, Employee referral bonus, Mentoring, Workstation reimbursement, Company share purchase plan, Childcare support programme, Bike parking, Playroom, Shower, Canteen, Free coffee, Free beverages, Free parking, In-house trainings, In-house hack days, No dress code, Modern office, Knowledge sharing, Garden, Massage chairs, Kitchen.

  • Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role Excellent experience in the Data Engineering Lifecycle. You will have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Senior stakeholder management skills.  Experience of modern Software Engineering principles and experience of creating well...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    Very good knowledge of Scala Spark GitHub Jira and Confluence Experience working within Scrum framework Fluent English Nice to have: GCP, and Apache Airflow JUnit, TDD, BDD Jenkins  Clean code, SOLID, KISS, DRY, design patterns Elasticsearch Experience in at least of the large Cloud providers (Azure, AWS) Pervious Secure Code Warrior certifications Some...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role At least +8 years of experience in Software Engineering Strong technical expertise in Scala and Spark Big data technologies is essential with Devops and Cloud skills considered as secondary but valuable Previous cloud experience (GCP)  End to end systems architecture knowledge Knowledge of technologies and...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    Knowledge of Scala Spark Ability to manage branches and resolve merge conflicts Fluent English Nice to have: Experience with  Jira and Confluence GCP, and Apache Airflow JUnit, TDD, BDD Jenkins Clean code, SOLID, KISS, DRY, design patterns Elasticsearch Experience in at least one of the large Cloud providers (Azure, AWS) Pervious Secure Code Warrior...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    Strong experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark). Proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms (AWS, Azure, Google Cloud) and their data services. Certifications in cloud platforms (AWS Certified Data Analytics, Google...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    Required skills: Deep knowledge on Google Cloud Platform - GCP Certification is a plus 3+ years of experience as DevOps Good working knowledge of Jira and Confluence, Git. Unix administration skills, Bash/shell scripting Automation toolset (Jenkins, Terraform and/or Ansible), Previous experience in agile and scrum methodologies Fluent English Experience in...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role 3+ years of experience of Cybersecurity SME/Product Owner/Engineering/Strategy areas  A background in information systems, technology, architecture, design, and service delivery of defense-in-depth capabilities.    Strong stakeholder management skills, with experience of understanding and meeting the needs...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    Elastic Search SME Google Cloud Platform Knowledge of Hadoop ecosystem DevOps / Agile practices (Scrum / KANBAN) Jira and Confluence Good communication skills in English (Discussing, presenting) Nice to have: Very good knowledge of Scala Spark JUnit, TDD, BDD RHEL / shell scripting / REGEX Clean code, SOLID, KISS, DRY, design patterns Experience in at...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role Minimum 5 years of experience in data analytics, business intelligence, or related areas. Strong grasp and understanding of fundamental data modelling concepts such as entity-relationship modelling, data flow diagrams, and the ability to create conceptual data models from business requirements.  Strong SQL...


  • Kraków, Czech Republic HSBC Technology Poland Full time

    What you need to have to succeed in this role Proficient in Python programming, VBA and SQL Knowledge of Jira, Git, test driven development  Experience with Product Control Financial data Experience in designing microservice-driven system architectures  University graduate from a reputed institution in engineering, finance, economic subjects or...