This job ad has been posted over 40 days ago...
0
applicants
Data Engineer
at RefJobs in New South Wales
Position: Data Engineer
Location: Remote
Implementing Spark pipelines using Scala for it.
· Then, the candidate must have enough understanding and experience
working with Spark.
· How to create, deploy and execute spark applications to apply
complex transformations to the data.
· At least it is required to be at a middle level. For example, how
to: create, join, filter, and transform Data Frames, efficiently.
About Scala, need to be focusing on Spark applications.
· Then the candidate should know enough to implement Spark pipelines.
· An expert on Scala is not needed, but at least to have good
fundamentals.
· Understand the primary types of objects/structures like Case
Classes, Tuples, and Collections
· How to interact with Collections to transform them (map, flat Map,
foreach, etc.), and How to deal with NULLS that are discouraged in Scala.
Reference : Data Engineer jobs
Reference : Data Engineer jobs
Recent jobs at RefJobs
Sr. Golang Developer at RefJobs in New South Wales
06-04-2024
SDET Lead at RefJobs in New South Wales
06-04-2024
Salesforce Developer at RefJobs in New South Wales
26-12-2023
Data Engineer at RefJobs in Victoria
04-12-2023
React Frontend Architect at RefJobs in New South Wales
01-10-2023
Published at 16-01-2023
Viewed: 94 times
Viewed: 94 times