Databricks Engineer
$160,000–$200,000 year
HybridNew York City, New York, United States or New York, United States
New York City, New York, United States or New York, United StatesHybridContract$160,000–$200,000 yearLarge
ContractLarge
Job Summary
Centralize cashflow aggregation onto a Databricks and Deltalake platform by collecting, cleaning, and enriching real-time and batch data from multiple sources. Store aggregated data in Deltalake for reporting while guiding the bank's early-stage transition, managing migration costs, and prioritizing use cases. Communicate with data providers and consumers to map requirements and fields across business units and asset classes. This hybrid role at Treliant supports a large global bank's regulatory compliance and risk functions in the Greater New York City metro area.
Required Qualifications
- at least one Databricks platform implementation
- familiarity with ETL/ELT in Databricks
- familiarity with Medallion architecture
- familiarity with Deltalake
- experience with Streaming technologies such as Kafka
- experience with Delta Share and Deltalake Connector
- SQL skills
- Python skills
- PySpark skills
- background in financial products and processes
- knowledge of Cashflow forecasting and liquidity management
- knowledge of Financial products including securities such as swaps
- knowledge of banking products such as loans
- knowledge of Reference data including counterparty and business hierarchy data
- knowledge of Regulatory and risk management reporting needs
- experience of the challenges of aggregating data in bulk across business units and asset classes
- ability to communicate and lead
- ability to guide and understand aspects of the migration such as cost management and use case prioritization
- ability to communicate with data providers and data consumers to understand the requirements and to source and map the needed data fields
- hybrid role availability in the Greater New York City metro area
Desired Qualifications
- Experience in data migration
- Experience in data integration
- Experience in delivery of data warehouses
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.