Business & Data Analyst – Enterprise Data Platform - #2204350
Vbeyond
We are seeking an experienced Business & Data Analyst with strong Commodity Trading / ETRM knowledge, preferably Endur, and hands-on experience delivering Data Warehouse, Data Lake or Lakehouse projects.
The role will bridge business requirements and technical data engineering, working closely with business stakeholders, architects and engineers to build and validate an enterprise Data Lake/Lakehouse on Azure and Databricks.
This is not a traditional functional Business Analyst role. Candidates must have strong technical data analysis capabilities, including SQL, source-to-target data mapping, data testing, reconciliation and an understanding of modern data engineering patterns.
Key Responsibilities- Gather and translate business, functional and technical data requirements into BRDs, user stories, acceptance criteria and engineering-ready requirements.
- Conduct workshops with Trading, Risk, Finance and other business stakeholders.
- Analyse Endur/ETRM data, including Trades, P&L, Risk, Market Data and related business processes.
- Create detailed source-to-target data mappings, transformation rules and business logic.
- Work with architects and engineers to define requirements for Bronze, Silver and Gold / Medallion architecture.
- Understand data solutions built using Azure Databricks, Delta Lake, Delta Live Tables / Lakeflow Declarative Pipelines, Structured Streaming and dbt.
- Define and execute data testing, data quality checks, reconciliation and source-to-target validation using SQL and analytical techniques.
- Validate batch and streaming data pipelines and support SIT/UAT and production validation.
- Define requirements and acceptance criteria for data pipeline performance, scalability, reliability and optimisation.
- Analyse workloads and business requirements to support Databricks and Azure cost optimisation.
- Work with engineering teams to validate performance improvements and cost optimisation outcomes.
- Define metadata, lineage, data quality and governance requirements.
- Own requirements throughout the full lifecycle: discovery, mapping, engineering clarification, testing, UAT and business acceptance.
- Business and Data Analysis experience on Data Lake, Data Warehouse or Lakehouse projects.
- Advanced SQL for data analysis, validation and reconciliation.
- Strong source-to-target data mapping experience.
- Data testing and reconciliation experience.
- Strong understanding of data modelling and Medallion architecture.
- Experience with Azure and Databricks-based data platforms.
- Understanding of Delta Lake, Structured Streaming and data pipelines.
- Requirements gathering, BRDs, user stories and acceptance criteria.
- Strong stakeholder management and technical communication skills.
- Commodity Trading / ETRM domain knowledge, preferably Endur.
- Understanding of Trade, P&L, Risk and Market Data.
- Databricks Delta Live Tables / Lakeflow Declarative Pipelines.
- dbt.
- Python.
- Azure Data Factory.
- Azure Data Lake Storage (ADLS).
- Data quality and reconciliation frameworks.
- Databricks/Azure performance and cost optimisation concepts.
- Business and Functional Requirements.
- Engineering-ready User Stories and Acceptance Criteria.
- Source-to-Target Data Mapping.
- Transformation and Business Rules.
- Data Quality and Reconciliation Rules.
- Data Test Scenarios and Validation Results.
- Performance and Scalability Requirements.
- Databricks/Azure Cost Optimisation Requirements.
- SIT/UAT and Business Validation Support.
- Metadata, Lineage and Governance Requirements.
The ideal candidate combines three core capabilities:
- Business and Trading Knowledge: Comfortable discussing Endur trades, P&L and risk requirements with business stakeholders.
- Strong Data Analysis: Able to create data mappings, define transformation logic and independently validate data using advanced SQL.
- Technical Data Platform Understanding: Able to work closely with data engineers and architects on Azure Databricks, Lakehouse architecture and modern data pipelines.
Candidates should be able to translate complex trading and business requirements into clear engineering specifications and independently validate whether the delivered data platform meets expected business outcomes.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Actuarial Project Director
sterling swaps trader - Selby Jennings
Reconciliations Intermediate Analyst - Citi