Data Engineer - Remote
- Free
- Published date: December 7, 2022
-
- Victoria, Australia
eRole: Data Engineer
Location: Remote
Contract
NOTE- Must have experience with Spark pipelines implementation
Job Description :
Implementing Spark pipelines using Scala for it.
· Then, the candidate must have enough understanding and experience
working with Spark.
· How to create, deploy and execute spark applications to apply
complex transformations to the data.
· At least it is required to be at a middle level. For example, how
to: create, join, filter, and transform Data Frames, efficiently.
About Scala, need to be focusing on Spark applications.
· Then the candidate should know enough to implement Spark pipelines.
· An expert on Scala is not needed, but at least to have good
fundamentals.
· Understand the primary types of objects/structures like Case
Classes, Tuples, and Collections
· How to interact with Collections to transform them (map, flat Map,
foreach, etc.), and
How to deal with NULLS that are discouraged in Scala.
Reference : Data Engineer - Remote jobs
Useful information
- Avoid scams by acting locally or paying with PayPal
- Never pay with Western Union, Moneygram or other anonymous payment services
- Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
- This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"
