Large Scale Data Systems Developer

Big Data Expert WantedWe are looking for a highly skilled professional to design and develop large-scale data processing systems using Scala and Spark.Job OverviewThis role requires expertise in big data technologies, including Hadoop and Elasticsearch.The ideal candidate will have strong knowledge of Scala, Spark, and Agile methodologies.The selected...

Job Overview:Hitachi Energy is seeking a highly skilled software developer to design, implement, and maintain cutting-edge platforms and environments.This role requires collaboration in a team environment to deliver large system solutions, analyzing engineering, business, and software requirements, proposing technically feasible solutions, researching and...

You're ideal for this role if you have:Strong experience in PySpark, Scala, or similar data engineering languages Hands-on experience building production data pipelines using Hadoop, Spark, and Hive Knowledge of cloud platforms and migrating on-premise solutions to the cloud Experience with scheduling tools such as Airflow and workflow...

Minimum 5 years of overall IT experience, including 2+ years in software development with Big Data technologies, microservices, and cloud-based event-driven architectures.Strong hands-on expertise with Apache NiFi, Apache Kafka, Apache Spark, Apache Hive, Apache HDFS, Apache Oozie, SQL, Python, Google SDK, REST API, Linux Shell Scripting.Solid database...

Role OverviewAdvanced Data Engineer - Scala and Big Data Expertise RequiredAs a key member of our team, you will be working in the Google Cloud Platform (GCP) environment. Your primary responsibility will be to create data pipelines using Spark Shell for analysing large-scale data stored in one of the world's biggest Datalakes.Your work involves...

Required Skills & Experience:Minimum 5 years of experience in engineering Big Data environments (on-prem or cloud)Strong understanding of Hadoop ecosystem: Hive, Spark, HDFS, Kafka, YARN, ZookeeperHands-on experience with Cloudera distribution setup, upgrades, and performance tuningProven experience with scripting (Shell, Linux utilities) and Hadoop system...

You're ideal for this role if you have:5+ years of experience engineering solutions in big data, on-prem or cloud environments Strong problem-solving skills and adaptability to complex environments Hands-on experience in backend development and API integration Proven expertise with microservices architecture and distributed systems Experience with CI/CD...

Have a deep understanding of data modelling (for both operational and analytical systems), data analysis, metadata,Have a strong understanding of data governance principles and can establish and enforce data governance frameworks, data quality standards, and data protection measures.Good to have:Experience in cloud data solutions (e.g., AWS, Azure, Google...

Requirements:Degree in Math/Computer Science/Finance/Accounting or others1+ year of relevant experienceExperience in automating processes within a complex, large scale environmentPractical UiPath experienceHands-on VBA / Google Scripting experienceBasic SQL knowledgeKnowledge of other programming language is a distinct advantage (Python preferable)Ability to...

Job Title: Big Data Expertise EngineerJob DescriptionAs a skilled data engineer, you will play a pivotal role in creating innovative solutions for managing and analyzing large datasets. Your primary focus will be on utilizing Scala and Spark to design and implement scalable data pipelines that cater to the needs of our organization.Key responsibilities...