Senior Data Engineer
1 month ago
What's important for us?
- At least 7+ years of professional experience in data-related role
- Experience with infrastructure-as-code tools, like Terraform
- Proficiency in using Airflow
- Expertise in AWS stack and services (EC2, ELB, IAM, RDS, Route53, S3, and more)
- Proficiency in using Docker
- Expertise in Python and SQL languages
- Experience with data warehouses (Snowflake)
- Experience with different types of database technologies (RDBMS, vector, graphs, document based, etc.)
- Great analytical skills and attention to detail - asking questions and proactively searching for answers
- Excellent command in spoken and written English, at least C1
- Creative problem-solving skills
- Excellent technical documentation and writing skills
- Ability to work with both Windows and Unix-like operating systems as the primary work environments
- Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
You will score extra points for:
- Experience with integrating LLMs (OpenAI but also others, maybe open source)
- Familiarity with data visualization in Python using either Matplotlib, Seaborn or Bokeh
- Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
- Knowledge of any Python web framework, like Django or Flask with SQLAlchemy
- Experience in operating within a secure networking environment, like a corporate proxy
- Experience in working with repository manager, for example Jfrog Artifactory
Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives.
The project:
We are carrying out the project for our client, an American private equity and investment management fund - listed on the Forbes 500 list - based in New York.
We support them in the area of the infrastructure and data platform, and very recently we also build and experiment with Gen AI applications. The client operates very widely in the world of finance, loans, investments and real estate.
As a Senior Data Engineer you’ll design and implement core systems that enable data science and data visualization at companies that implement data-driven decision processes to create a competitive advantage.
You’ll build data platform for data and business teams, including internal tooling, data pipeline orchestrator, data warehouses and more, using:
Technologies: Python, Terraform, SQL, Pandas, Shell scripts
Tools: Apache Airflow / Astronomer, GIT, Docker, Kubernetes, Snowflake, Pinecone, Neo4j, Jenkins, Jupyter Notebook, OpenAI API, Artifactory, Windows with WSL, Linux, Gitlab
AWS: EC2, ELB, IAM, RDS, Route53, S3, and more
Best Practices: Continuous Integration, Code Reviews
The ideal candidate will be well organized, eager to constantly improve and learn, driven and, most of all - a team player
Requirements BenefitsWhat do we offer?
- Working alongside a talented team of software engineers who are changing the image of Poland abroad
- Culture of teamwork, professional development and knowledge sharing (
- Flexible working hours and remote work possibility
- Comfortable office in central Warsaw, equipped with all the necessary tools for conquering the universe (Macbook Pro/Dell, external screen, ergonomic chairs)
Sounds like a perfect place for you? Don’t hesitate to click apply and submit your application today
,[Developing PoCs using latest technologies, experimenting with third party integrations , Delivering production grade applications once PoCs are validated , Creating solutions that enable data scientists and business analysts to be self-sufficient as much as possible. , Finding new ways how to leverage Gen AI applications and underlying vector and graph data storages , Designing datasets and schemes for consistency and easy access , Contributing data technology stacks including data warehouses and ETL pipelines , Building data flows for fetching, aggregation and data modeling using batch and streaming pipelines , Documenting design decisions before implementation ] Requirements: Data modeling, Terraform, Airflow, AWS, Docker, Python, SQL, Analytical skills, Kubernetes, Data visualization, Snowflake, Jupyter Notebook, Artifactory, Linux, GitLab, NumPy, SQLAlchemy, JFrog Artifactory Additionally: Remote work, MacBook, Knowledge sharing, Flexible working hours, Competitive compensation, Sport subscription, Private healthcare, Flat structure, Small teams, International projects, Modern office, Free coffee, Canteen, Bike parking, Playroom, Shower, Free snacks, Free beverages.-
Senior Data Engineer
4 weeks ago
Remote, Warszawa, Czech Republic Sunscrapers Full timeSenior Data EngineerAre you a seasoned data professional looking to take your career to the next level? We're seeking a highly skilled Senior Data Engineer to join our team at Sunscrapers, a leading force in software development.About the RoleWe're looking for a talented individual to design, build, and maintain our data infrastructure, leveraging expertise...
-
Senior Data Engineer
4 weeks ago
Remote, Warsaw, Warszawa, Czech Republic Sunscrapers Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Sunscrapers. As a key member of our data-centric environment, you will design and implement core systems that enable data science and data visualization at companies that implement data-driven decision processes to create a competitive advantage.Key ResponsibilitiesDesign...
-
Remote, Warsaw, Czech Republic emagine Sp. Z o.o. Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our Agile data team working on a global platform designed to collect and harmonize data from various Operational Technology sources.As a key member of our team, you will be responsible for building production-ready stable and scalable data pipelines, acting as a trusted advisor to...
-
Senior Data Engineer
3 weeks ago
Warszawa, Mazovia, Czech Republic Link Group Full timeJob Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team at Link Group. As a Senior Data Engineer, you will be responsible for establishing a solid data infrastructure that will support our Client's data-driven HR strategies, enabling data-driven decision-making.Key Responsibilities:Design and deploy efficient data...
-
Senior Data Platform DevOps Engineer
4 weeks ago
Remote, Warszawa, Czech Republic Swing Development Full timeAbout the RoleWe are seeking a highly skilled Senior Data Platform DevOps Engineer to join our team at Swing Development. As a key member of our engineering team, you will play a crucial role in designing, building, and maintaining secure, scalable data infrastructure and pipelines.As a Senior Data Platform DevOps Engineer, you will be responsible for...
-
Senior Data Engineer
4 weeks ago
Remote, Warszawa, Czech Republic Sunscrapers Full timeSenior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Sunscrapers. As a key member of our data team, you will be responsible for designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from a variety of data sources.Key Responsibilities:Design...
-
Senior Data Engineer
4 weeks ago
Remote, Czech Republic Antal Sp. z.o.o. Full timeSenior BI - Data EngineerWe are seeking a highly skilled Senior BI - Data Engineer to join our team in Wrocław. As a key member of our data engineering team, you will be responsible for designing and implementing data engineering solutions that empower our business intelligence capabilities.Key Responsibilities:Design and implement data engineering...
-
Senior Data Engineer Specialist
2 weeks ago
Warszawa, Mazovia, Czech Republic ITDS Full timeAre you a skilled data engineer looking to take your career to the next level?We're seeking a Senior Big Data Engineer to join our team at ITDS, a leading global provider of advanced analytics and innovative technology solutions.As a Senior Big Data Engineer, you will design, develop, and support data engineering solutions that help solve complex business...
-
Senior Big Data Engineer
4 weeks ago
Warszawa, Mazovia, Czech Republic ITDS Full timeUnlock Your Potential as a Senior Big Data EngineerYou're an expert in Big Data Stream processing with a strong background in Scala and Apache Spark. You're also familiar with SQL and transactional databases, and have experience with Azure. Your skills in Apache Spark, Apache Kafka, Apache Flink, and HDFS make you a valuable asset to our team. Additionally,...
-
Senior Data Engineer
4 weeks ago
Remote, Warsaw, Czech Republic emagine Sp. Z o.o. Full timeJob Description:We are seeking a highly skilled Data Engineer to join our team at emagine Sp. Z o.o. The ideal candidate will have a strong background in data engineering principles, including data warehousing, batch processing, data streaming, data lakes, databases, and data modeling.Key Responsibilities:Design and implement scalable and efficient data...
-
Senior Data Engineering Lead
3 weeks ago
Warsaw, Rzeszów, Kraków, Gdańsk, Wrocław, Czech Republic EcoVadis Full timeJob Title: Senior Data Engineering LeadAt EcoVadis, we are seeking a highly experienced Senior Data Engineering Lead to join our team. The ideal candidate will have a strong background in software engineering, data engineering, and machine learning, with significant experience in leading teams and driving technical innovation.Key Responsibilities:Build,...
-
Senior Data Engineer @ N-iX
1 month ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full time6+ years of experience in Data Engineering, with a strong emphasis on architecture Proven expertise in Azure and Databricks technologies Azure Databricks certification is a must In-depth knowledge of data lakehouse concepts, data management processes, and data integration techniques Experience with performance tuning and optimization of data...
-
Senior Big Data Engineer @ ITDS
1 month ago
Warsaw, Czech Republic ITDS Full timeYou’re ideal for this role if you have: 5+ years of experience with Big Data Stream processing (Scala, Apache Spark) Knowledge of SQL and transactional databases Previous experience with Azure Experience with one or more of Apache Spark, Apache Kafka, Apache Flink, HDFS Knowledge of the NoSQL database such as Hive, HBase, Cassandra, ElasticSearch or...
-
Senior Data Engineering Manager
2 weeks ago
Warsaw, Rzeszów, Kraków, Gdańsk, Wrocław, Czech Republic EcoVadis Full timeJob Description:We are seeking a highly skilled Senior Data Engineering Manager to lead our team of data engineers and machine learning experts. The ideal candidate will have a strong background in software engineering, data engineering, and machine learning, with experience in managing and growing high-performing teams.Key Responsibilities:Build and mentor...
-
Senior Data Architect
4 weeks ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full timeSenior Data EngineerWe are seeking a highly skilled Senior Data Engineer specializing in Databricks to help with the engineering side of a significant data transformation program for our customer.Key Responsibilities:Work closely with cross-functional teams to grasp business requirements and architect scalable, efficient data solutions.Define data...
-
Senior Data Engineer
3 weeks ago
Remote, Kraków, Wrocław, Warsaw, Czech Republic N-iX Full timeJob Title: Senior Data EngineerJob Description:We are seeking a highly skilled Senior Data Engineer to join our team at N-iX. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that support our client's high-quality licensed images, videos, and music.Key Responsibilities:Design and develop...
-
Machine Learning Engineer
1 month ago
Remote, Warszawa, Czech Republic Data Science UA Full time- Experience as a Machine Learning Engineer.- Degree in Computer Science, Mathematics, Statistics, or a related field, or equivalent practical experience.- Good knowledge of deep learning, natural language processing (NLP) and/or LLMs.- Proficiency in the software development in one or more programming languages (including Python).- Minimal expertise in data...
-
Senior Data Engineer and Architecture Lead
3 weeks ago
Remote, Czech Republic AVENGA Full timeAt AVENGA, we're seeking a seasoned Senior Data Engineer and Architecture Lead to spearhead our data engineering efforts and drive innovation in our data architecture. This is a fantastic opportunity to join a dynamic team and make a meaningful impact on our business.Salary: $150,000 - $200,000 per annum, depending on experience and qualifications.Job...
-
Senior Data Engineer
4 weeks ago
Remote, Wrocław, Gdańsk, Warsaw, Kraków, Czech Republic Elitmind Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Elitmind. As a key member of our Data Engineering team, you will be responsible for developing and maintaining our data and reporting platforms.Key ResponsibilitiesOversee the entire engineering lifecycle and ensure successful data platform implementationDrive competency...
-
Senior Cloud Data Engineer
4 weeks ago
Remote, Czech Republic Hirely Sp. z o.o. Full timeKey Responsibilities:Design and implement data pipelines using PySpark and SQL.Manage infrastructure in AWS, including S3, Docker, and Kubernetes.Work with Databricks, Unity Catalog, Workflows, jobs, and data visualization in notebooks.Implement CI/CD solutions using CircleCI.Requirements:5+ years of experience as a Data Engineer.Proficient in Databricks,...