LLM Pre-Training Engineer @

2 weeks ago


Budapest, Budapest, Czech Republic E-Group ICT Software Zrt. Full time
The ideal candidate can:
  • Forecast GPU-hour budgets and advise on reserved vs spot capacity strategies
  • Run continuous evaluation sweeps (MMLU, HELM) and interpret scaling-law curves
  • Work together with DevOps on cluster events and with ML engineers on model specs
What we expect:
  • Deep expertise in PyTorch Distributed, FSDP, DeepSpeed or Megatron-Core
  • Demonstrated success training multi-billion-parameter models at scale
  • Familiarity with data-engineering stacks (Ray Data, Petastorm, WebDataset)
  • Solid CUDA background and ability to write/modify custom GPU kernels when needed

E-Group is an innovative deep-tech, high-tech mid-market company with a strong vision, a fast-growing and friendly atmosphere, and a dynamic team of experts working on next-generation, beyond-state-of-the-art, future-proof technologies in artificial intelligence core technology stack, payment transactions, and digital identification.

Since its foundation in 1993, E-Group has gained a strong track record of successful projects in the healthcare, financial, energy, and government sectors. As an active member of the European innovation ecosystem, it leads or participates in many top-tier projects each year with EU Institutions, European universities, companies, and financial institutions to apply the latest scientific advances to real customer needs.

We are looking for YOU if:
  • The "impossible" for you is just another challenge
  • You inspire your environment with your original way of thinking
  • You want to be involved in world-class, professionally inspiring development projects
What We Offer:
  • Competitive salary commensurate with experience
  • Real professional challenges where you can apply and develop your skills
  • A stable corporate environment
  • Long-term job opportunities
  • Varied international projects
  • Modern, technological environment, modern equipment
  • Friendly, supportive, and professionally committed team
  • Personal and professional development opportunities
  • A pleasant working environment in Buda, surrounded by greenery, in a family atmosphere

If you know yourself from the description, then E-Group is the place for you.

We care about who you are, your goals, and what person you want to become. We offer a place where you can add value not only with your skills, but also with your personality.

We look forward to receiving your application with a photo CV

,[Design and implement tensor, pipeline, MoE and ZeRO-3 parallelism strategies for LLM models, Build real-time utilisation dashboards and autoscale GPU clusters (Slurm / Karpenter), Implement fault-tolerant checkpointing and rapid resume logic for spot-instance fleets] Requirements: PyTorch, FSDP, DeepSpeed, Megatron-Core, Data engineering, Petastorm, Ray Data, WebDataset, GPU, CUDA Additionally: Magánegészségügyi ellátás, Csoportos élet- és balesetbiztosítás, Training budget, International projects, Külföldi konferenciák, Flat structure, Barátságos csapat, Ingyenes kávé, tea, snack, Free parking, Mobiltelefon, Bike parking, Shower, Pihenő zóna, Startup atmosphere, Modern budai iroda, No dress code.

  • Budapest, Budapest, Czech Republic GG Development Kft. Full time

    At least a BSc degree in computer science with 2+ years of experience in native mobile development and/or test automation Experience in working with various programming languages (e.g., Java, Swift) Experience in creating and working with CI/CD pipelines Experience in working with automated testing frameworks and tools Knowledge of testing methodologies...

  • QA Engineer @

    2 weeks ago


    Budapest, Budapest, Czech Republic GG Development Kft. Full time

    At least a BSc degree in computer science with 2+ years of experience in software testing (manual + technical)Strong understanding of QA methodologies (functional, regression, smoke, UAT, exploratory)Experience with API testing tools (e.g., Postman, SoapUI)Familiarity with databases (basic SQL queries for test data setup and validation)Understanding of SDLC...


  • Budapest, Budapest, Czech Republic NIX Tech Kft. Full time

    English level Upper-Intermediate (B2) and higher.1+ years of proven experience developing software using Python/Scala.Good knowledge of SQL.Being familiar with one or more of the following databases - PostgreSQL, MySQL, Oracle, MSSQL.Being familiar with any cloud platform (GCP, AWS, Azure) basics concepts.Experience with any orchestration tools (Airflow,...


  • Budapest, Budapest, Czech Republic NIX Tech Kft. Full time

    Experience in administering Linux/UNIX and Windows systems (practical experience is mandatory, at least two years).Experience in configuring web servers and deploying applications, as well as supporting their operation.Experience deploying environments in AWS or Azure clouds (manually or using Terraform, CloudFormation or ARM templates).Basic knowledge of...


  • Budapest, Budapest, Czech Republic NIX Tech Kft. Full time

    Minimal hands on experience in at least one programming language, such as Java, Python, JS or C#Basic understanding of automated testingTheoretical understanding of Agile methodology and software development principlesStrong problem-solving and analytical skillsEnglish skills at the upper-intermediate or higher levelWILL BE A PLUS:Experience in working with...

  • Cloud Platform

    2 weeks ago


    Budapest, Budapest, Czech Republic E-Group ICT Software Zrt. Full time

    The ideal candidate can:Tune container runtimes for secure, low-overhead ML workloadsAutomate GPU node provisioning and autoscalingFacilitate smooth hand-offs with ML & LLM Training engineers via well-defined APIsWhat we expect:4 + years running mission-critical workloads on public cloud platformsExperience with infrastructure-as-code (IaC) tools such as...


  • Budapest, Budapest, Czech Republic Deutsche Telekom IT Solutions Hungary Full time

    Requirements Profile:You have sophisticated knowledge & experience in software development and wish to have fun while continuously improving yourself learning together with us on the job.Essential:Excellent knowledge and experience in Kubernetes ClusterExcellent knowledge in AnsibleInfrastructure as Code (e.g.: Terraform, Kubernetes, Helm)Experience with Git...


  • Budapest, Budapest, Czech Republic Siemens Mobility Kft. Full time

    Te vagy az ideális jelölt, ha:Informatikai, villamosmérnöki, gépészmérnöki vagy bármilyen hasonló műszaki felsőfokú végzettséggel rendelkezel.Van legalább 1 év mérnöki területen szerzett tapasztalatod.Aktív, minimum középfokú német nyelvtudásod van írásban és szóban egyaránt.Analitikus, struktúrált és minőség-orientált...

  • Data Science Lead @

    2 weeks ago


    Budapest, Budapest, Czech Republic NIX Tech Kft. Full time

    Strong technical skills in code review, architecture, and data models.Experience designing ML pipelines, including data collection, wrangling, training and validating ML, delivering, and serving.Passion for continuous learning and improvement.Ability to accurately estimate time and resources for projects.Ability to manage timelines and deadlines while...


  • Budapest, Budapest, Czech Republic beBeeSoftwareEngineer Full time €50,000 - €80,000

    Software Engineer PositionJoin a dynamic team of experts in cross-media surveys and examinations, and workflow management systems for quality control of study programs.We seek an accomplished software engineer to develop innovative solutions using Clojure as the backend and React-based client framework.As part of our agile development team, you will...