Serverless file-processing integration pipeline
A scalable, event-driven pipeline that imports structured data files into Dataverse — resilient, configuration-driven and self-service.
The problem
Structured files (CSV and Excel) needed to land in Dataverse reliably, at variable volumes, without a developer touching code for every new file format.
Our approach
Blob Storage triggers publish file metadata to Service Bus; an Azure Function acts as a generic import engine driven by a declarative configuration (a small DSL). Retries and dead-lettering protect against data loss, and file routing archives or quarantines each file by outcome.