Content Comparison

SFTP Client

Authentication & Authorization

• Microsoft Entra ID (Azure Active Directory Identity) not supported for SFTP endpoint.

• ACLs (Access Control lists) not supported for SFTP endpoint.

• Local user is the only form of identity management supported.
  Network

• Network must open port 22

• Static IP addresses are not supported.

• Must use Microsoft Internet Routing as Internet routing is not supported.

• 2-minute timeout for standby or inactive connections.
  Performance

• Performance degradation over time, impact of network latency.
  Other

• Constraint on use of account hierarchical namespace functionality (must be enabled, requires Azure Data Lake Gen2 capabilities).

• Maximum file size is 100 GB.

• To launch storage redundancy/replication, SFTP must be deactivated.

AzCopy Utility

• Synchronous operation only, no asynchronous copying.

• Potential timeout, dependency on on-premise infrastructure, dependency on our network.

• Impact of log generation on performance.

• Unexpected behavior: if file size reaches 200 GB, AzCopy splits the exported file.

• No traceability, just a technical log.

Azure Data Factory

• Resource limitations - but not really, as it's designed for large quantities of data.

• If we develop pipelines and there is a lot of transformation that is done outside ADF's native activities, this will make it more difficult to estimate the cost of the operation at the end.

• Long-term operations are more expensive than on-premise solutions.

Azure Function

• Not suitable for long, resource-intensive runs.

• Cold-start latency means you have to pay more for the plan.

• Despite stateless architecture, if data persistence is required, then the architecture becomes more complex as data is fetched across services.

• Limited debugging