Job #: 2828

Title: Big Data Developer

Region:

  • New York City, NY
  • Job Type:

  • Contract
  • Contract Pay Rate:
  • $50-75
    • Anywhere
    • Posted 4 weeks ago

    ​This position is for a hands-on Developer in the Distributed Data Development team of the North America based Credit Risk Technology group.T he successful candidate will have an opportunity to work closely with the Credit Risk business unit, IT business analysts, GUI development teams and Data providers and consumers to deliver Credit Risk Data Warehouse systems related projects.

    The candidate must have minimum 10 years hands-on IT experience, preferably in the financial services industry working on all aspects of SDLC with focus on large volume data processing applying complex business rules, performing transformation, aggregation and designing data persistence model for Transactional Data Processing (OLTP) as well as Data Warehouse.

    Must have strong ability to work on multiple IT projects simultaneously, working with the stake holders, clients and other system owners to drive the projects to successful completion.

    Must have previous involvement in data modeling and/or systems architecture.

    Responsibilities will include technical analysis, design, development and perform enhancements.

    The candidate will participate in all of the following activities:

    Strong knowledge of database table partitions, data distribution, parallel loads and extracts working on DB2 DPF or Greenplum or other big data technologies

    Hands-on development experience working with large data volumes, building distributed processing using Java or Python on Spark, data frames, externalizing business rules etc.

    Build batch vs. event driven data processing.

    Design for high level of concurrency to ensure data integrity without compromising performance

    Working in a agile squad as a contributor, working with other developers towards a common goal

    Modeling and implementing database schemas

    Coming up with system architecture/re-design proposals for greater efficiency and ease of maintenance and developing software to turn proposals into implementations

    Skills Required:

    Strong hands-on knowledge of Python or Java as a distributed data developer, working on large data volumes (20m+ rows per day)

    Ability to deliver multiple simultaneous projects under pressure of regulatory driven deadlines

    10+ years of relational database experience with emphasis on data processing as described above

    Hands-on experience with Greenplum / DB2 / Teradata / Oracle

    Excellent analytical ability ?Strong collaboration and communication skills

    Skills Desired :

    Credit risk knowledge

    Job scheduler knowledge

    Autosys​

     

    Your Name*

    Your Email*

    Your Phone*

    Your Message

    Please attach your Resume*