This job ad has been posted over 40 days ago...
0
applicants
Data Engineer with Spark
at kartikeysinghpaliwal in United States Of America
Position: Data Engineer
Location: Remote
Contract
Job Description:
Implementing Spark pipelines using Scala for it.
· Then, the candidate must have enough understanding and experience
working with Spark.
· How to create, deploy and execute spark applications to apply
complex transformations to the data.
· At least it is required to be at a middle level. For example, how
to: create, join, filter, and transform Data Frames, efficiently.
About Scala, need to be focusing on Spark applications.
· Then the candidate should know enough to implement Spark pipelines.
· An expert on Scala is not needed, but at least to have good
fundamentals.
· Understand the primary types of objects/structures like Case
Classes, Tuples, and Collections
· How to interact with Collections to transform them (map, flat Map,
foreach, etc.), and How to deal with NULLS that are discouraged in Scala.
Reference : Data Engineer with Spark jobs
Reference : Data Engineer with Spark jobs
Recent jobs at kartikeysinghpaliwal
Senior Java Developer at kartikeysinghpaliwal in Texas
18-02-2023
SAP CAR Consultant at kartikeysinghpaliwal in North Carolina
18-02-2023
Python Developer at kartikeysinghpaliwal in Georgia
23-01-2023
Salesforce Solution Architect - O'Fallon, MO(Hybrid) at kartikeysinghpaliwal in Texas
23-01-2023
Published at 16-01-2023
Viewed: 110 times
Viewed: 110 times