Senior Data and AI Engineer - Finance
Databricks · Bengaluru, India · 7+ yrs experience · Posted 2026-07-01
Tech stack: GitHub Actions, Go, Python, SQL
About the role
About the Role
As a Finance Data and AI Specialist, you will be a hands-on contributor building and maintaining the data pipelines, applications, and AI-powered tools that support Databricks' Finance and Accounting organisation. This is part of the Finance org. You will report to the Senior Manager, Finance Data and AI and work as a core member of a team that combines engineering rigour with Finance domain knowledge.
This role is ideal for someone who is technically strong, eager to go deep on the Databricks Platform, and excited to apply modern data and AI tooling to real Finance problems.
What You Will Do
Build and maintain finance data pipelines in the Finance DataLake using Databricks Jobs and Lakeflow Lakeflow Spark Declarative Pipelines, including data validation and reconciliation logic
Develop and iterate on AI-assisted tools for the Finance and Accounting organisation, including automation of manual workflows, anomaly detection, and reporting enhancements
Contribute to the development of Finance applications (Databricks Apps, Genie Spaces, dashboards) that enable self-service analytics for Finance stakeholders
Build and maintain reports and dashboards for monthly, quarterly, and executive-level reporting
Support the implementation of row-level security and data access policies across Finance DataLake datasets
Work with Accounting, FP&A, Internal Audit, and Procurement teams to gather requirements and deliver well-documented technical solutions
Follow Git-based version control, pull-request review processes, and CI/CD pipelines (Declarative Automation Bundles, GitHub Actions) to meet SOX change management requirements
Support financial close by monitoring pipelines, investigating data issues, and escalating as needed
Participate in UAT for new system integrations and assist with technical documentation
Contribute to team coding standards and data modelling conventions under the guidance of the Finance Data Lead
What We Look For
7+ years of experience in data engineering, analytics engineering, or finance systems
Proficiency in SQL and Python for pipeline development; hands-on experience with Apache Spark or the Databricks platform is a strong plus
Experience connecting to and ingesting from financial source systems (NetSuite, Salesforce, Stripe, Zuora, or similar)
Working knowledge of finance and accounting concepts, including close processes, revenue recognition, and financial reporting
Ability to translate Finance requirements into clean, maintainable technical solutions with guidance
Comfortable communicating across technical and non-technical audiences
Experience contributing to BI dashboards and self-service data products
Curiosity about AI/ML and interest in applying new techniques to Finance workflows
Nice to Have
Prior experience at a high-growth SaaS or cloud infrastructure company
Exposure to AI/BI tools, Genie, or LLM-powered applications
Qualifications
- 7+ years of experience in data engineering, analytics engineering, or finance systems
- Proficiency in SQL and Python for pipeline development; hands-on experience with Apache Spark or the Databricks platform is a strong plus
- Experience connecting to and ingesting from financial source systems (NetSuite, Salesforce, Stripe, Zuora, or similar)
- Working knowledge of finance and accounting concepts, including close processes, revenue recognition, and financial reporting
- Ability to translate Finance requirements into clean, maintainable technical solutions with guidance
- Comfortable communicating across technical and non-technical audiences
- Experience contributing to BI dashboards and self-service data products
- Curiosity about AI/ML and interest in applying new techniques to Finance workflows
- Nice to Have
- Prior experience at a high-growth SaaS or cloud infrastructure company
- Exposure to AI/BI tools, Genie, or LLM-powered applications
Responsibilities
- Build and maintain finance data pipelines in the Finance DataLake using Databricks Jobs and Lakeflow Lakeflow Spark Declarative Pipelines, including data validation and reconciliation logic
- Develop and iterate on AI-assisted tools for the Finance and Accounting organisation, including automation of manual workflows, anomaly detection, and reporting enhancements
- Contribute to the development of Finance applications (Databricks Apps, Genie Spaces, dashboards) that enable self-service analytics for Finance stakeholders
- Build and maintain reports and dashboards for monthly, quarterly, and executive-level reporting
- Support the implementation of row-level security and data access policies across Finance DataLake datasets
- Work with Accounting, FP&A, Internal Audit, and Procurement teams to gather requirements and deliver well-documented technical solutions
- Follow Git-based version control, pull-request review processes, and CI/CD pipelines (Declarative Automation Bundles, GitHub Actions) to meet SOX change management requirements
- Support financial close by monitoring pipelines, investigating data issues, and escalating as needed
- Participate in UAT for new system integrations and assist with technical documentation
- Contribute to team coding standards and data modelling conventions under the guidance of the Finance Data Lead