Job #: 2828
Title: Big Data Developer
This position is for a hands-on Developer in the Distributed Data Development team of the North America based Credit Risk Technology group.T he successful candidate will have an opportunity to work closely with the Credit Risk business unit, IT business analysts, GUI development teams and Data providers and consumers to deliver Credit Risk Data Warehouse systems related projects.
The candidate must have minimum 10 years hands-on IT experience, preferably in the financial services industry working on all aspects of SDLC with focus on large volume data processing applying complex business rules, performing transformation, aggregation and designing data persistence model for Transactional Data Processing (OLTP) as well as Data Warehouse.
Must have strong ability to work on multiple IT projects simultaneously, working with the stake holders, clients and other system owners to drive the projects to successful completion.
Must have previous involvement in data modeling and/or systems architecture.
Responsibilities will include technical analysis, design, development and perform enhancements.
The candidate will participate in all of the following activities:
Strong knowledge of database table partitions, data distribution, parallel loads and extracts working on DB2 DPF or Greenplum or other big data technologies
Hands-on development experience working with large data volumes, building distributed processing using Java or Python on Spark, data frames, externalizing business rules etc.
Build batch vs. event driven data processing.
Design for high level of concurrency to ensure data integrity without compromising performance
Working in a agile squad as a contributor, working with other developers towards a common goal
Modeling and implementing database schemas
Coming up with system architecture/re-design proposals for greater efficiency and ease of maintenance and developing software to turn proposals into implementations
Strong hands-on knowledge of Python or Java as a distributed data developer, working on large data volumes (20m+ rows per day)
Ability to deliver multiple simultaneous projects under pressure of regulatory driven deadlines
10+ years of relational database experience with emphasis on data processing as described above
Hands-on experience with Greenplum / DB2 / Teradata / Oracle
Excellent analytical ability ?Strong collaboration and communication skills
Skills Desired :
Credit risk knowledge
Job scheduler knowledge