Big Data Engineer

IF YOU AREExperienced with Python and PySparkProficient in Databricks Lakehouse architecture and principlesSkilled in designing data models, building ETL pipelines, and wrangling data to solve business challengesKnowledgeable in Azure cloud technologies, including Azure Data Factory, Azure DevOps, Azure Synapse, and Azure Data Lake ServicesAdvanced in SQL...

Comscore, a global leader in media analytics, is seeking a skilled Scala/Linux Big Data Developer to join our team in Poland and around the world.We're looking for someone with expertise in designing, implementing, and maintaining petabyte-scale big data pipelines using Scala, Kubernetes, and other technologies.The ideal candidate will have a solid...

We are currently seeking resources with experience in building and taking to production low latency, Massive Parallel Processing (MPP) data and analytic systems, ideally on Hadoop, Scala and Spark. The Candidate that meets the following criteria:∙Computer Science Degree/Student ∙3+ years strong native SQL skills ∙3+ years strong experience in...

Must-Have QualificationsAt least 3+ years of experience in data engineering.Strong expertise in one or more cloud platforms: AWS, GCP, or Azure.Proficiency in programming languages like Python, SQL, or Java/Scala.Hands-on experience with big data tools such as Hadoop, Spark, or Kafka.Experience with data warehouses like Snowflake, BigQuery, or...

We are currently seeking a Strategic Data Engineering Lead with expertise in Scala and Spark to join our team and contribute to innovative, large-scale data processing projects.About the RoleThe ideal candidate will have experience in designing, implementing, and optimizing big data processing pipelines using Scala and Spark. They will work with massive...

The candidate must have:2+ years of experience with LinuxSolid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows)Huge need to drive projects of the future, improve stuff, risk taking mindset - covered...

4+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industryProven experience as a Data Engineer with a focus on cloud-based solutions.Strong proficiency in Python, and PySparkHands-on experience with Azure cloud servicesExpertise in data modeling, database design, and optimization.Familiarity with Big Data...

Company OverviewN-iX is a leading IT services company that provides innovative solutions to businesses across various industries.Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining sophisticated data pipelines in Palantir Foundry.Required Skills and...

Qualifications:Strong proficiency in Scala and the ability to design and build robust backend services. Experience with Python for data pipeline development, ETL processes, or data integration Solid understanding of database systems (SQL/NoSQL) and experience working with large datasets. Experience with K8S, writing and maintaining Helm...

About Data Science UA:">We are a service company with strong data science and AI expertise, fostering the largest Data Science Community in Eastern Europe.About Our Client:">The company is a market-leading intelligence platform for paid search advertising, leveraging artificial search intelligence and industry knowledge to drive value from PPC budgets.About...

About AddeptoAddepto is a cutting-edge consulting and technology company specializing in AI and Big Data. We partner with top-tier global enterprises and pioneering startups to deliver innovative data projects.Exciting Project OpportunitiesDesign and Development of Azure Data Platform: Migrate SSAS cube objects and SSIS pipelines from on-premises SQL Server...

We are seeking a highly experienced Data Engineer to lead our team in building a next-generation Global Data Lake and Analytics platform.This role involves designing and delivering data models, which power business intelligence initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases. You will work closely with data architects on...

+3 years of experience in large scale, distributed server side, backend developmentExtensive experience in stream & batch big data pipeline processing using Apache SparkExperience with Linux, Docker, and KubernetesExperience in working with cloud providers (e.g., AWS, GCP)Strong experience with event streaming platforms like Kafka or its alternatives, such...

Position Overview: As an AI/ML Engineer, you will play a crucial role in enhancing our platform's capabilities by developing and refining machine learning models that drive accurate forecasting, event analysis, data-driven decision-making, and more. You will collaborate closely with product owners and engineering teams to implement scalable AI solutions that...

About SyncronSyncron is a leading SaaS company with over 20 years of experience, specializing in aftermarket solutions. Our Service Lifecycle Management Platform offers domain-fit solutions for supply chain optimization, pricing strategy, service fulfillment, warranty management, field service management, service parts management, and knowledge management.We...

Requirements:5+ years of experience in software development and data engineering. Bachelor's degree in computer science, Information Technology, or related field. Strong proficiency in Python, .NET, and Azure services. Experience with Azure Data Analytics tools (e.g., Azure Data Lake, Synapse). Proficiency in building scalable and secure APIs (REST,...

Job DescriptionWe are seeking a highly skilled Linux Systems Engineer to join our team at Comscore (via CC). As a key member of our technical staff, you will be responsible for designing and implementing scalable cloud infrastructure solutions using AWS. Your expertise in Linux internals, programming languages, and DevOps practices will enable us to deliver...

5+ years of experience in data engineering with a software development background.Strong expertise in Azure (Data Factory, Databricks, PySpark/.NET for Spark)Strong expertise in SQL.Proficiency in Python, .NET (C#), and Azure for data processing.Experience with Azure Data Analytics tools (e.g., Azure Data Lake, Synapse, Cosmos DB).Strong analytical and...

Industry experience in building, deploying and maintaining high performing, resilient, and scalable real-time machine learning systems.Expert knowledge of Python and experience in building micro-services that can scale effectively.Knowledge of SQL, data modelling, and dimensionality modelling conceptsFamiliarity with modern ETL stack (Airflow, DBT,...

Job DescriptionWe are seeking a highly skilled Lead Data Engineer to join our team at Matrix Global Services.About the RoleThe successful candidate will lead development projects of critical, high-availability cloud-scale services and APIs. They will support clients with large amounts of data and scalability in mind.Key Responsibilities:Leverage expertise in...