Cloud Platform Big Data Engineer II

TD Description

About TD Bank, America's Most Convenient Bank®

TD Bank, America's Most Convenient Bank, is one of the 10 largest banks in the U.S., providing more than 8 million customers with a full range of retail, small business and commercial banking products and services at approximately 1,300 convenient locations throughout the Northeast, Mid-Atlantic, Metro D.C., the Carolinas and Florida. In addition, TD Bank and its subsidiaries offer customized private banking and wealth management services through TD Wealth®, and vehicle financing and dealer commercial services through TD Auto Finance. TD Bank is headquartered in Cherry Hill, N.J. To learn more, visit Find TD Bank on Facebook at and on Twitter at

TD Bank, America's Most Convenient Bank, is a member of TD Bank Group and a subsidiary of The Toronto-Dominion Bank of Toronto, Canada, a top 10 financial services company in North America. The Toronto-Dominion Bank trades on the New York and Toronto stock exchanges under the ticker symbol "TD". To learn more, visit

Job Description

NOTE: This position is 100% remote and candidates can be located anywhere in the US.

We are looking for an Azure Big Data Engineer to work across multiple diverse businesses within TD to deliver enterprise data services/capabilities and solutions on Azure. The perfect candidate will have previous Azure cloud experience delivering enterprise data solutions within financial services including knowledge of the security and regulatory requirements. The role will focus on Azure DataBricks, Azure Synapse, Azure Data Lakes and Azure Machine Learning.
You will work in collaboration with cloud engineering, network, security and risk management to deliver secured Azure data solutions that meet security policies and standards within TD. You will collaborate with developers in our Azure engineering team and lines of business to implement and continuously improve the framework and tools to support self-service automation of the platform. You will develop data migration and ingestion patterns and automation in Jenkins, Terraform, Azure Python SDK and GitHub Runners to automate builds, data migration and data ingestion into the platform.
• Design and build modern Data Pipelines/Streams and Data Service APIs to assist with data migration (on-premise SQL to Azure SQL databases, on-premise Hadoop to Azure Data lake...)
• Write and use Azure RM templates and Terraform
• Understand product features for DR/BCP options and how fits in overall application architecture
• Create design/architecture patterns covering HA and DR/BCP
• Understand security features and for Azure Data solutions (data protection, authentication, RBAC, audit logging...)
• Troubleshoot Application connectivity/access to Azure data products (NSG, basic routing)
• Understand and develop concepts related to deploying databases via CI/CD pipeline
• Ensure that all cloud solutions follow internally defined security and compliance controls
• Implement the enterprise cloud capability and enhance the cloud orchestration platform for automated provisioning, management and scalability of hosts, containers, applications and cloud services

Job Requirements

• College degree, or specialized training / equivalent work experience
• 5-7 Years of related experience
• 3+ years of experience developing platform orchestration code in Azure Python SDK, Terraform and GitHub Runners
• Strong programming skill with experience in API and Webhook development using Python, Ruby, PowerShell and Shell Scripting languages
• Experience with automating (provisioning, configuration management, deployment) and integrating Azure Data PaaS solutions (Azure SQL, Azure Cosmos DB, Azure SQL Datawarehouse, Azure Data Lake, Azure Databricks, Azure HDInsight...).
• Demonstrated knowledge of cloud provisioning and administration, cloud bursting, cloud interoperability, cloud disaster recovery and business continuity strategies, as well as performance measurement and monitoring in the cloud
• Experience in Azure RBAC and integration with Active Directory and PingFed
• Must be a self-starter, demonstrated ability to take independent action to achieve results.
• Excellent written and verbal communication skills with the ability to communicate clearly with all levels within the team
• Highly developed critical thinking, analytical and problem solving skills
• Advance knowledge of software development lifecycle and working in an Agile Scrum team
• Demonstrated effective leadership and analytical skill
• Proficiency in cloud automation using native Azure CLI
• Ability to participate in fast-paced DevOps Engineering teams within Scrum agile processes
• A critical thinker with strong research and analytics skills
• Self-motivated with a positive attitude and an ability to work independently and in a team
• Able to work under tight timeline and deliver on complex problems
• Must be eligible for employment under regulatory standards applicable to the position.


At TD, we are committed to fostering an inclusive, accessible environment, where all employees and customers feel valued, respected and supported. We are dedicated to building a workforce that reflects the diversity of our customers and communities in which we live in and serve, and creating an environment where every employee has the opportunity to reach their potential.

If you are a candidate with a disability and need an accommodation to complete the application process, email the TD Bank US Workplace Accommodations Program at . Include your full name, best way to reach you, and the accommodation needed to assist you with the application process.

EOE/Minorities/Females/Veterans/Individuals with Disabilities/Sexual Orientation/Gender Identity.