NHSX Data Engineering Docs

Core Products

• NHS App Analytics Dashboard
  • NHS App
  • NHS-App-Analytics-Dashboard
    • Information you can get through the dashboard
    • How to access the dashboard
    • Background to the NHS App dashboard
  • NHS App Data Dictionary
  • Change log
    • NHS App Dashboard v1.4
    • Data Caveats
    • 1. Features Added:
    • 2. User Interface Changes:
    • 3. Features Removed:
    • Version 1.3 Change Log (29-09-2020)
    • 1. User Verification Process:
    • 2. Updated Registration Metric:

Data Engineering

• Azure Platform Overview
  • Data Engineering Repositories
    • Our Core Repositories
    • Our Product Repositories
• Azure Data Factory Templates
  • SQL Database Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Databricks Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Excel Sheet Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Multiple Excel Sheet Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Web URL Data Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Azure Function App Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • SharePoint Ingestion Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Databricks Processing Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Databricks Orchestration
    • Data Factory Configuration
  • Azure Function App Processing Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Multiple Azure Function Apps Processing Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Copy File Processing Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • SQL Table Staging Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
  • Multiple SQL Table Staging Pipeline
    • Metadata
    • Description
    • Pipeline Configuration
    • Data Factory Configuration
• Azure Data Factory Utilities
  • Latest Folder Lookup
    • Metadata
    • Problem
    • Pipeline setup
    • Loop setup
    • Conditional setup
    • Copy Data setup
    • Data Factory Configuration
• Azure Databricks Functions
  • DataLake to Pandas
    • Metadata
    • Imports
    • Download
    • Upload

Open Analytics

• Open Analytics Template
  • GitHub API
  • Plotly
  • Github Actions
    • Events that trigger workflows
    • Jobs
    • Steps
  • GitHub Pages

Appendix

• Changelog
  • v0.0.2
    • New Features
    • Fixes
  • v0.0.1
    • New Features
    • Fixes
    • Other Changes