This job ad has been posted over 40 days ago...
0

applicants

Full-time DataLake Technical Consultant

at Centraprise Global in New Jersey

Job Title: DataLake Technical Consultant

Location: Camden, NJ (Remote till Covid)

Duration: Contract

Client: Cognizant



Job Description:

Apache NiFi, AWS Cloud tools such as S3, Athena, Redshift, Cloud9, Data
Pipeline, Kafka, Glue, Scala/Pyspark, EMR(AWS & Big Data technologies)

· Design data ingestion and data processing pipelines using technologies such
as Apache NiFi, Amazon MSK, Amazon EMR, PySpark, Scala, Athena, Glue and Data
Pipelines to bring the data from Hana into Datalake that resides on Amazon S3.

· Design data ingestion and data processing pipelines to move the data from S3
into data warehouse built using Amazon Redshift.

· Develop design of data visualization layer that will be built using Amazon
Redshift for Amazon Quicksight.

· Build data ingestion and data processing pipelines using the above-mentioned
technologies to bring the data from Hana into Amazon S3.

· Working Knowledge of Python, JSON, Scala, Pyspark

· Knowledge to use to python programs to integrate with Spark and utilize AWS
Cloud tools such as Data Pipeline, EMR etc.

· Knowledge of JSON programs to utilize EMR cluster to use the metadata to
write pipelines

· Working knowledge on converting orc to parquet

· Build data ingestion and data processing pipelines to move the data from S3
into Amazon Redshift.

· Build datasets in Amazon Quicksight utilizing the Redshift Data. Create
Analysis and publish dashboards in Quicksight using the datasets.

· 3 to 4 years in AWS Cloud (Senior)


Reference : DataLake Technical Consultant jobs


Recent jobs at Centraprise Global
Full-time Sr SAP EHS Consultant at Centraprise Global in Illinois 15-04-2021
Full-time Mobile Developer at Centraprise Global in Texas 15-04-2021
Full-time AWS Administrator at Centraprise Global in California 15-04-2021
Full-time SAP WM/LE Consultant at Centraprise Global in Minnesota 15-04-2021
Full-time WAS Admin at Centraprise Global in Idaho 13-04-2021

« Go back to category
Is this job ad fake? Report it!   
Recommend to a friend
Published at 27-02-2021
Viewed: 23 times