Hadoops/Sparks Engineer at jobsatsalado / America Jobs

This job ad has been posted over 40 days ago...

applicants

Hadoops/Sparks Engineer

at jobsatsalado in North Carolina

Title - Hadoops/Sparks Engineer
Location - Durham, NC
Duration - Contract

Job Description:

The Team:
Part of the team which acquire, transform, manage and distributes data to
multiple groups within the Company to perform business critical functions which
includes investment decisions, performance of funds, index, and manage
reference data for securities. The primary role of this group is to acquire
data from multiple market providers like Bloomberg, Morning Star, S&P, Moody's,
Fitch etc. and prepare data in business-friendly format by applying business
transformation and validations. Once the data is converted into
business-friendly format make the data available to multiple consumers through
API, Feed, Golden Gate distribution and other channels like Queue, Streaming
etc.

The Role:
As part of UAP (Unified Acquisition Platform) team you will be working on
enhancing the next generation in-house acquisition platform using cloud
technologies. UAP will be built using Java Spark and Python programming
language and use AWS EMR as the infrastructure for execution. You would be
developing lambda, Spark, Python utilities for managing end to end feed flow.
We will focus on building tools and capabilities to accelerate acquisition,
compare data across vendors, externalize rules for data conversion, build
inventory/registry of feeds and track lineage.

You would be focusing on:
Develop new application for managing feed inventory and tracking their usage
Developing application interface using Java Spark for converting vendor feeds
into business-friendly format
Develop accelerators for new feed acquisition
Develop accelerators for data comparison reports
Developing Lambda triggers for event driven and batch driven use case
Supporting production during warranty period
Participate in code review and define standard methodology
Manage branching and deployments without conflicts
Provide L3 production support
Enhancing framework for future needs and make it a more generic product.

The Expertise and Skills You Bring:
Bachelor in information technology.
6+ years of experience with application development and hands on experience
with Spark/Scala.
Expertise in providing leadership support by providing technical solutions.
Expertise in handling huge dataset.
Expertise in code reviews for standards and efficient coding practices.
Expertise in building monitoring and alerting tools to report failure or
potential performance degradation.
Experience with TDD (Test driven development) to build unit testing and
robust regression test suite.

COVID Work Policy:
Safety is our top priority. Once we can be together in person with fewer
safety measures, this role will follow our dynamic working approach. You'll be
spending some of your time onsite depending on the nature and needs of your
role.

Dynamic Working - Post Pandemic:
Our aim is to combine the best of working offsite with coming together in
person. For most teams this means a consistent balance of working from home and
office that supports the needs of your role, experience level, and working
style.

Your success and growth is important to us, so you'll want to enjoy the
benefits of coming together in person - face to face learning and training,
quality time with your manager and teammates, building your career network,
making friends, and taking full advantage of cultural and social experiences
our Company provides for you.

Company Overview:
Our Company is the in-house temporary staffing provider for Company's
Investments, one of the largest and most diversified global financial services
firms in the industry. We recruit individuals from a variety of backgrounds,
including technology and customer service, to fill assignments across regional
and investor center locations. If you would like to experience our diverse and
inclusive workplace while expanding your skill set and developing your
professional network, consider a role with our Company.

We will reasonably accommodate applicants with disabilities who need
adjustments in order to complete the application or interview process.

Information about our Company Investments:
We are focused on making our financial expertise broadly accessible and
effective in helping people live the lives they want. We are a privately held
company that places a high degree of value in creating and nurturing a work
environment that attracts the best talent and reflects our commitment to our
associates. We are proud of our diverse and inclusive workplace where we
respect and value our associates for their unique perspectives and experiences.
We are equal opportunity employers.

Reference : Hadoops/Sparks Engineer jobs

» Apply now