Opis:
We are looking for a person for the position of Data Engineers/Big data
What we offer
- work in an international environment
- attractive salary
- possibility of remote work
Your tasks
- You will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high quality ETLs.
- This is an exciting opportunity to build a new greenfield solution, working as part of a small team, to help the business improve their market making capabilities within the fixed income space.
- The platform itself is housed within the AWS ecosystem.
-
Job Responsibilities / Role - Take responsibility for the software delivery by ensuring quality and scope expectations are met.
- Contribute and take ownership of the technical design and ensure all aspects of the system architecture are well documented.
- Work closely with partner technology teams and to collaborate effectively.
What we expect
- Experience Python, Pyspark, Pandas, JulyterLab (working with notebooks).
- Experience using AWS platform.
- Experience with continuous integration and continuous delivery tools like Git, Jenkins etc.
- Agile development/Software life cycle
- Knowledge around BI tools (Qlik, Tableau, Power BI,… )
Nice to have Skills:
- Experience with Kafka
- Experience in SQL, Hive, Hadoop.
- Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark clusters.
- Knowledge of Terraform
- Experience with Ansible, Bash scripting, boto3
- Experience configuring continuous integration and continuous delivery tools.
Employment agency entry number 47
this job offer is intended for people over 18 years of age
4 gru 2025;
from:
www.jobs.pl