The Role
The PDE team (Partners Data Engineering team) is currently in the process of consolidating data from applications provided by other partners. The initial phase involves ingesting data into an “operational” data store that accurately reflects the source structure in a virtual one-to-one manner.
What you will do
- Design and implement scalable data pipelines using Apache Airflow (MWAA) to orchestrate data workflows across multiple AWS services
- Write and maintain Python scripts for data processing, transformation, and validation tasks
- Develop SQL queries and stored procedures for data extraction and transformation across various databases (MySQL, PostgreSQL, Snowflake)
- Create and maintain Infrastructure as Code (IaC) using CloudFormation for AWS resources and Liquibase for database schema management
- Build ETL processes utilizing AWS services
- Integrate and consume REST APIs for data ingestion and synchronization
- Implement data quality checks using pythonic data validation frameworks to ensure data reliability and consistency
- Design and maintain data models that align with business requirements and performance standards
- Troubleshoot pipeline issues and optimize performance across the entire data stack
- Create comprehensive documentation covering: Data pipeline architectures, ETL processes and workflows, Data models and schemas, System configurations, Operational procedures
- Monitor pipeline performance and implement improvements for efficiency and scalability
- Establish and maintain best practices for data engineering processes and coding standards
Requirements
- Python
- SQL
- Infrastucture as Code (Cloudformation)
- Apache Airflow
- AWS RDS, S3, Athena
- RDBMS databases (MySQL, PostgreSQL)
- Linux knowledge (SSH, Bash scripting)
Nice to have
- AWS CloudWatch, EMR, DMS, MWAA
- Experience working with REST APIs
- Infrastructure as Code (IaC)
- Liquibase
- OLAP DBs: Snowflake
- Familiarity with Data Quality frameworks (e.g.: Great Expectations)
What we offer
- Hybrid working model with remote work opportunities (*) and flexible working hours
- Private Health Insurance
- People Lead system for your personal development
- A culture of continuous growth, providing various training resources
- Referral System
- Agile mindset, simplified processes, and a great atmosphere where commitment and autonomy are celebrated
- A community-first mindset working with talented people across technology products and consulting
(*) As we hire permanent employees for this role, we offer remote opportunities only in Romania, Lithuania and Hungary.
Additional benefits based on location:
Hungary:
- 20 vacation days, increasing according to labour law
- Extensive cafeteria package
- Commuting allowance
Lithuania:
- 20 vacation days
- 2 emergency days
- Pension plan
- Opportunity to work abroad for up to 180 days per year
- Discounts from the benefit platform
Romania:
- 24 vacation days, increased based on the work tenure
- 2 emergency days
- Meal tickets
- Opportunity to work abroad for 1 month
About us
Zenitech is a leading technology solutions provider dedicated to reshaping the global digital landscape. Headquartered in the UK, Zenitech operates internationally, with offices in Lithuania, Romania, and Hungary.
We use a bespoke approach depending upon where the client is on their digital journey, comprising a combination of access to dedicated R&D labs, technology implementation advice, and specialist nearshore development talent. As an international community of individuals who are open to learn from each other, we collectively define and input into the digital future of the clients’ businesses.
Why Zenitech?
- Impactful Projects: Drive meaningful change through digital transformation projects and have an opportunity to make an impact on many different industries.
- Collaborative Culture: Be part of a diverse, inclusive team committed to growth, innovation, and continuous learning.
- Professional Growth: Zenitech supports continuous learning and development through the People Lead system, helping you advance your skills and career.
Diversity and Inclusion
Zenitech celebrates diversity in all its forms. We aim to create an inclusive environment where everyone feels valued for their unique contributions and perspectives. If you require any adjustments during the application process, please let us know—we’re here to help. Our commitment to diversity, equity, inclusion, and belonging can be found here.