Azure Back Ground Services For File Processing

12/25/2019

We currently have Window service to process Inbound/outbound files. In Bound files we read data and perform some calculations and store data in Database. Out Bound files we generate data from the database.

We want to migrate to azure now. I have following questions .

1) what is the best way to store files in azure (Blob or File Share in azure) . We have only ".pdf,.txt,.xlsx" formats no videos

2) Which process is better to process files - WebJobs, Virtual Machine and install window service , Azure Batch Jobs, azure kubernetes service,Service Fabric.

Please some can help me on this.

Thanks

-- Rahul Kumar
azure
azure-appfabric
azure-kubernetes
azure-web-sites

1 Answer

12/26/2019

How are you receiving the files API, FTP or some other way? There are a ton of details that are needed to really answer this, but here are my thoughts.
Blob storage would be more cost effective. You only need to use a file share if you want to be able to map a network drive from a VM. If processing one file would complete in less than 10 minutes I would look at Azure functions for that. If you’re processing thousands of files per day Azure functions would be expensive so I would look at running them on an App Service on VMs or moving to Service Fabric. If you have a web site that’s used to upload the files and you’re already using Azure App service then you could use Web Jobs.

-- Nate
Source: StackOverflow