Data Engineer – Trino/Apache Trino @ Upvanta

Strong proficiency in Trino (Starburst or Apache) – installation, configuration, tuning. Cloud platform knowledge (AWS) – designing and deploying scalable data environments. Hands-on experience in monitoring and troubleshooting distributed queries. Solid understanding of security frameworks (LDAP, Ranger, etc.). Proficiency in Python, SQL, Bash,...

As a junior linux engineer in big data validation, you will join an international team and collaborate with industry leaders.Our company is a global leader in media analytics, providing insights into consumer behavior and digital engagement.We are seeking a skilled engineer to work closely with our ai and data engineering teams to ensure the quality of data,...

 Oczekiwania: Doświadczenie w pracy z Apache NiFi w projektach produkcyjnych. Dobra znajomość integracji danych z różnych źródeł. Umiejętność analitycznego myślenia i rozwiązywania problemów. Wiedza z zakresu bezpieczeństwa danych i zasad data governance. Komunikatywność oraz umiejętność pracy w zespole. Poszukujemy...

Wymagania: Bardzo dobra znajomość Pythona w kontekście inżynierii danych. Doświadczenie w orkiestracji procesów danych (Apache Airflow lub podobne). Znajomość AWS Services (m.in. Glue, S3, Lambda, Redshift). Doświadczenie w integracji i automatyzacji rozwiązań w obszarze platform danych. Mile widziana praktyczna wiedza z...

Requirements: Minimum 8 years of experience in Data Engineering At least 4 years of hands-on experience with Databricks, including services like data pipelines and Unity Catalog At least 2 years of experience working with Big Data technologies Proficiency in Python and SQL Solid background in data warehousing, ETL, distributed data processing, software...

An ideal candidate would have:A solid foundation in Python programming, future proficiency in SQL, and a solid basic understanding of statistical concepts. Python programming, proficiency in SQL, and a basic understandingKnowledge of testing methodologies and practical experience in API testing and data testingExperience in testing large datasets is...

Job OpportunityWe are seeking a seasoned professional to spearhead the development of our Big Data systems. The ideal candidate will possess strong programming skills in Python or Java/Scala, experience in designing and implementing data governance and management processes, and familiarity with Big Data technologies such as Spark, Cloudera, Airflow, NiFi,...

An ideal candidate would have: A solid foundation in Python programming, future proficiency in SQL, and a solid basic understanding of statistical concepts. Python programming, proficiency in SQL, and a basic understanding Knowledge of testing methodologies and practical experience in API testing and data testing Experience in testing large datasets is...

Doświadczenie: Praca z hurtowniami danych w chmurze (preferowane Snowflake). Realizacja projektów z zakresu Data Quality (walidacja przepływów danych, projektowanie reguł DQ, porównania danych źródłowych i wynikowych). Bardzo dobra znajomość: Snowflake (projektowanie, walidacja, monitorowanie danych). SQL (tworzenie zapytań kontrolnych,...

Proven experience with Apache NiFi in a production environment. Strong understanding of data ingestion workflows and integration from multiple sources. Hands-on experience with databases (SQL/NoSQL) and cloud storage solutions (AWS, Azure, or GCP). Knowledge of data governance, security, and compliance best practices. Strong troubleshooting and...