Meklēšanas rezultātiSpark Pipeline Developer, Music Services

509

Spark Pipeline Developer, Music Services

DataArt Ltd

Spark Pipeline Developer, Music Services

DataArt Ltd

Apraksts
Pamatinformācija
Uzņēmums

Job descriprion

Client

Our client is a music services company that specializes in music publishing and rights management, offering technology-based solutions to artists, songwriters, and rights holders.

Position overview

The focus of the role will be programming our Spark pipeline and the automated tests for it.

Pienākumi

Izstrādāt un uzturēt Java/Scala/Python lietojumprogrammas, izmantojot mūsdienīgu Java (Java 11+) un Spring Boot.
Izstrādāt, ieviest un optimizēt SQL vaicājumus un mijiedarbību ar datu bāzēm.
Integrēt Kafka reāllaika datu straumēšanai un apstrādei.
Konteinerizēt lietojumprogrammas, izmantojot Docker efektīvai izvietošanai un mērogojamībai.
Izmantojiet AWS pakalpojumus lietojumprogrammu izvietošanai, uzraudzībai un pārvaldībai.
sadarboties ar dažādu jomu komandām, lai izstrādātu un ieviestu AWS infrastruktūru, izmantojot Terraform.
Īstenot bezserveru risinājumus, izmantojot AWS Lambda, un organizēt darba plūsmas, izmantojot Step Functions.
pārvaldīt datu glabāšanas risinājumus, tostarp Redshift, un īstenot datu migrācijas stratēģijas, izmantojot DMS
pēc vajadzības pārcelt Oracle PL/SQL kodu un optimizēt veiktspēju un savietojamību
Pēc izvēles piedalīties projektos, kuros izmanto Python īpašām funkcijām vai automatizācijas uzdevumiem.

Prasības

Pieredze ar mūsdienīgu Java (Java 11+)
Pieredze infrastruktūras nodrošināšanā, CI/CD cauruļvadu pārveidošanā un stabilas ražošanas sistēmas, kas spēj tikt galā ar lielām slodzēm, programmēšanā.
Pieredze ar Spark
Pieredze ar Spring Boot
Pieredze ar SQL zināšanām
Pieredze ar Kafka
Pieredze ar Docker
Iepriekšēja AWS pieredze
Pieredze ar Kubernetes
Terraform

Responsibilities

Develop and maintain Java/Scala/Python applications using modern Java (Java 11+) and Spring Boot
Design, implement, and optimize SQL queries and database interactions
Integrate Kafka for real-time data streaming and processing
Containerize applications using Docker for efficient deployment and scalability
Utilize AWS services for application deployment, monitoring, and management
Collaborate with cross-functional teams to design and implement AWS infrastructure using Terraform
Implement serverless solutions using AWS Lambda and orchestrate workflows with Step Functions
Manage data warehousing solutions, including Redshift, and implement data migration strategies using DMS
Port Oracle PL/SQL code as necessary and optimize for performance and compatibility
Optionally, contribute to projects involving Python for specific functionalities or automation tasks

Requirements

Experience with Modern Java (Java 11+)
Experience in provisioning infrastructure, modifying CI/CD pipelines and programming a robust production system that can handle heavy loads
Experience with Spark
Experience with Spring Boot
Experience with SQL expertise
Experience with Kafka
Experience with Docker
Previous AWS experience
Experience with Kubernetes
Terraform

What we offer

•Professional Development:

Experienced colleagues who are ready to share knowledge;

The ability to switch projects, technology stacks, and try yourself in different roles;

More than 150 workplaces for advanced training;

Study and practise English: courses and communication with colleagues and clients from different countries;

Support of speakers who make presentations at conferences and meetings of technology communities;

• Health insurance;

• The ability to focus on your work: a lack of bureaucracy and micromanagement, and convenient corporate services;

• Friendly atmosphere, concern for the comfort of specialists, contemporary office space;

• Flexible schedule (there are core mandatory hours), the ability to work remotely upon agreement with colleagues.

Mēneša bruto algaBruto mēnesī € 4300 - 4900

Atrašanās vieta

Latvija

Attālināta darba iespējas

Darba veids

Pilna slodze
Elastīgs darba laiks

Prasmes

Java/Scala/Python Spark Data Engineering

Valodas

Angļu

Kontaktpersona
DataArt DataArt
+37168621230

DataArt is a global software engineering firm that takes a uniquely human approach to solving problems.

DataArt has earned the trust of some of the worlds leading brands and most discerning clients, including Nasdaq, Travelport, Ocado, Centrica/Hive, Paddy Power Betfair, IWG, Univision, Meetup and Apple Leisure Group among others.

DATAART IN NUMBERS

• 6000+ professionals.

• 25 years in operation.

• 11+ countries.

• <10% attrition rate.

• 31% women.

• Glassdoor review score 4.7.

The results of team satisfaction survey 2021:

• 95% of our team members are ready to recommend us as a good employer to their friends;

• 92% of our team members are ready to spend 2+ more years of their career with us;

• 90% are satisfied with their total deal with DataArt.

DataArt ir globāls programmatūras inženierijas uzņēmums, kuram piemīt unikālas spējas sasniegt rezultātus balstoties uz korporatīvas kultūras vērtībām.

DataArt ir nopelnījies uzticamību dažu no pasaules vadošo zīmolu un prasīgāko klientu vidū, tostarp Nasdaq, Travelport, Ocado, Centrica/Hive, Paddy Power Betfair, IWG, Univision, Meetup un Apple Leisure Group.

DATAART SKAITĻOS

• 6000+ profesionāļu

• 25 gadi tirgū

• 11+ valsts

• <10% personāla mainības koeficients

• 31% sieviešu

• Glassdoor vērtējums 4.7

2021. gada komandas apmierinātības aptaujas rezultāti:

• 95% mūsu komandas dalībnieku ir gatavi ieteikt mūs kā labu darba devēju saviem draugiem;

• 92% mūsu komandas dalībnieku ir gatavi kopā ar mums pavadīt vēl 2+ savas karjeras gadus;

• 90% ir apmierināti ar sadarbību ar DataArt