This job ad has been posted over 40 days ago...
0

applicants

Full-time IT - Technology Architect | Big Data - Data Processing | Spark

at Hire it People Inc in California

Required Skills and Experience:

Bachelor's Degree in Computer Science, Engineering, or a related field and 8 years of experience
At least 8 years of experience building and managing complex products/solutions.
Good problem Solving/analytical skills & an absolute team player.
5 Plus years Experience developing Restful web services in any Java framework.
Minimum 5 years experience on Hadoop Ecosystem (Spark/Scala/Python preferred) & Backend software modules using Scala / Spark & java
Minimum 8 years of experience working in Linux / Unix environment.
Expert level programming in Java, Scala & Python.
Experience in developing ETL modules for the AI/ML use cases, developing algorithms & testing
Minimum 5 Years of experience on performance optimizations on Spark, Hadoop, Any NoSQL
Minimum 5 Years of experience on Testing and Debugging Data pipelines based on Hadoop and Spark
Experience with debugging production issues & performance scenarios
Roles & Responsibilities:

Design and development of java, Scala and spark based back end software modules, performance improvement and testing of these modules.
Scripting using python and shell scripts for ETL workflow. Design and development of back end big data frameworks that is built on top of Spark with features like Spark as a service, workflow and pipeline management, handling batch and streaming jobs;
Build comprehensive Big Data platform for data science and engineering that can run batch process and machine learning algorithms reliably
Design and development of data ingestion services that can ingest 10s of TB of data;
Coding for Big Data applications on clickstream, location and demographic data for behavior analysis using Spark / Scala & Java
Optimized resource requirements including number of executors, cores per executors, memory for Spark streaming and batch jobs
Expert level knowledge and experience in Scala, Java, Distributed Computing, Apache Spark, PySpark, Python, HBase, Kafka, REST based API, Machine Learning.
Development of AI/ML modules and algorithms for Verizon ML use cases.
Minimum years of experience : 10
Reference : IT - Technology Architect | Big Data - Data Processing | Spark jobs


Recent jobs at Hire it People Inc
Full-time IT - Senior Consultant | Microsoft Technologies | Dynamics CRM at Hire it People Inc in Texas 10-01-2021
Full-time IT - Senior Engineering Manager | Banking | Banking - ALL at Hire it People Inc in New Jersey 10-01-2021
Full-time AEM Architect at Hire it People Inc in Illinois 10-01-2021
Full-time Salesforce Architect at Hire it People Inc in New Jersey 10-01-2021
Full-time Salesforce Developers at Hire it People Inc in Illinois 10-01-2021

« Go back to category
Is this job ad fake? Report it!   
Recommend to a friend
Published at 19-11-2020
Viewed: 65 times