Sr Lead Software Engineer- Python, Databricks
On-siteJersey City, New Jersey, United States
Job Summary
Acquire data from primary or secondary sources, identify patterns in complex datasets, and transform existing ETL logic on AWS or Databricks platforms. Innovate new methods for managing, transforming, and validating data while implementing or enhancing services and scripts. Establish guidelines to ensure data asset quality and apply best practices to all work products. Analyze, design, and code business solutions using an Agile approach, partnering with stakeholders daily to deliver software on time and in budget. Lead cross-functional teams, manage hiring and talent development, and drive product strategy for the Client 360 Marketing and Events Data Platform.
Required Qualifications
- Advanced knowledge of application, data and infrastructure architecture disciplines
- 3+ years of Experience with Python
- 2+ years of Experience in Java Development
- 2+ Experience in a Big Data technologies (e.g. AWS, Spark, Kafka, Data Bricks etc.)
- Experience in implementing complex ETL transformations on big data platform
- Strong Experience with UNIX shell scripting to automate file preparation and database loads
- Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues
- Familiarity with relational database environment (Oracle, SQL Server, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy
- Strong development discipline and adherence to best practices and standards
- Experience developing or leading cross-functional teams of technologists
- Experience with hiring, developing, and recognizing talent
- Experience leading a product as a Product Owner or Product Manager
Desired Qualifications
- Experience of working in a development teams, using agile techniques and Object Oriented development and scripting languages, is preferred
- Comfortable learning cutting edge technologies and applications to greenfield project
- Experience working at code level
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.