Notice: Undefined index: HTTPS in /home/vivavhyh/america-jobs.net/page_job.php on line 68
Data Engineer at RefJobs / America Jobs
This job ad has been posted over 40 days ago...
0

applicants

Full-time Data Engineer

at RefJobs in New South Wales

Position: Data Engineer

Location: Remote

Implementing Spark pipelines using Scala for it. 

·         Then, the candidate must have enough understanding and experience
working with Spark. 

·          How to create, deploy and execute spark applications to apply
complex transformations to the data.

·          At least it is required to be at a middle level. For example, how
to: create, join, filter, and transform Data Frames, efficiently.

 

About Scala, need to be focusing on Spark applications. 

·         Then the candidate should know enough to implement Spark pipelines.

·          An expert on Scala is not needed, but at least to have good
fundamentals. 

·         Understand the primary types of objects/structures like Case
Classes, Tuples, and Collections

·         How to interact with Collections to transform them (map, flat Map,
foreach, etc.), and How to deal with NULLS that are discouraged in Scala.

 
Reference : Data Engineer jobs


Recent jobs at RefJobs
Full-time Sr. Golang Developer at RefJobs in New South Wales 06-04-2024
Full-time SDET Lead at RefJobs in New South Wales 06-04-2024
Full-time Salesforce Developer at RefJobs in New South Wales 26-12-2023
Full-time Data Engineer at RefJobs in Victoria 04-12-2023
Full-time React Frontend Architect at RefJobs in New South Wales 01-10-2023

« Go back to category
Is this job ad fake? Report it!   
Recommend to a friend
Published at 16-01-2023
Viewed: 94 times