deepset (Haystack)

German AI company behind Haystack — the open-source framework for building production RAG and agent applications

Portkey

AI gateway and LLMOps platform for routing, observability, and guardrails across multiple LLM providers

deepset (Haystack)

Excellent

24/25

Portkey

Moderate

15/25

Score Breakdown

Dimensiondeepset (Haystack)Portkey

Data Residency

Where is your data stored and processed?

deepset (Haystack): EU hosting available for managed platform. On-premises and air-gapped deployments fully supported. Open-source framework runs entirely locally with zero external data flow.

Portkey: US cloud by default but self-hosted deployment option allows EU data residency. Gateway architecture means LLM requests can be routed to EU-hosted providers.

5/5

EU hosting available for managed platform. On-premises and air-gapped deployments fully supported. Open-source framework runs entirely locally with zero external data flow.

3/5

US cloud by default but self-hosted deployment option allows EU data residency. Gateway architecture means LLM requests can be routed to EU-hosted providers.

Legal Jurisdiction

Which laws govern the company and your data?

deepset (Haystack): German GmbH, fully under EU law. Berlin headquarters. No US parent company. Investors include EU and US VCs but corporate governance remains German.

Portkey: Delaware incorporation. US jurisdiction. Self-hosted option eliminates cloud dependency for data-sensitive deployments.

5/5

German GmbH, fully under EU law. Berlin headquarters. No US parent company. Investors include EU and US VCs but corporate governance remains German.

2/5

Delaware incorporation. US jurisdiction. Self-hosted option eliminates cloud dependency for data-sensitive deployments.

Data Retention & Training

Is your data used for model training?

deepset (Haystack): Terms restrict data use to anonymised system data only. No explicit public 'we don't train' statement, but contractual restrictions are clear. Self-hosted gives full control.

Portkey: Gateway does not train on routed data. Observability logs are retained per customer policy. Self-hosted gives full control.

4/5

Terms restrict data use to anonymised system data only. No explicit public 'we don't train' statement, but contractual restrictions are clear. Self-hosted gives full control.

4/5

Gateway does not train on routed data. Observability logs are retained per customer policy. Self-hosted gives full control.

Certifications

ISO 27001, SOC 2, Cyber Essentials, etc.

deepset (Haystack): SOC 2 Type II, ISO 27001, HIPAA, and CSA STAR Level 1. Comprehensive certification suite for enterprise procurement. Third-party DPO (secjur).

Portkey: SOC 2 Type II certified. Appropriate for the company's stage. ISO 27001 would strengthen enterprise procurement.

5/5

SOC 2 Type II, ISO 27001, HIPAA, and CSA STAR Level 1. Comprehensive certification suite for enterprise procurement. Third-party DPO (secjur).

3/5

SOC 2 Type II certified. Appropriate for the company's stage. ISO 27001 would strengthen enterprise procurement.

Regulatory Fit

Suitability for regulated industries and professional services

deepset (Haystack): German GmbH with EU hosting, self-hosting option, and strong certifications. One of the best-positioned AI developer tools for EU regulated industries including financial services and healthcare.

Portkey: Self-hosted option enables EU deployment. SOC 2 certified. US jurisdiction applies to cloud product. Suitable for European teams managing multi-model AI infrastructure.

5/5

German GmbH with EU hosting, self-hosting option, and strong certifications. One of the best-positioned AI developer tools for EU regulated industries including financial services and healthcare.

3/5

Self-hosted option enables EU deployment. SOC 2 certified. US jurisdiction applies to cloud product. Suitable for European teams managing multi-model AI infrastructure.

Total Score

24/25

15/25

Best For

deepset (Haystack)

Best for EU-headquartered organisations needing maximum data sovereignty; organisations requiring broad certification coverage (SOC 2 Type II, ISO 27001, CSA STAR Level 1); regulated industries (BaFin, CNIL); privacy-conscious teams who need strong data retention controls; organisations that need self-hosted or on-premise deployment; teams on a tight budget.

Portkey

Best for privacy-conscious teams who need strong data retention controls; organisations that need self-hosted or on-premise deployment; teams on a tight budget.

Detailed Comparison

deepset (Haystack) vs Portkey: Trust & Compliance Comparison

deepset (Haystack) (deepset, DE) scores 24/25 overall with a Gold (Excellent) trust badge. German AI company behind Haystack — the open-source framework for building production RAG and agent applications. Portkey (Portkey, US) scores 15/25 with a Bronze (Moderate) trust badge. AI gateway and LLMOps platform for routing, observability, and guardrails across multiple LLM providers.

Dimension-by-Dimension Breakdown

#### Data Residency

deepset (Haystack) leads with 5/5 vs 3/5.

●deepset (Haystack) (5/5): EU hosting available for managed platform. On-premises and air-gapped deployments fully supported. Open-source framework runs entirely locally with zero external data flow.

●Portkey (3/5): US cloud by default but self-hosted deployment option allows EU data residency. Gateway architecture means LLM requests can be routed to EU-hosted providers.

#### Legal Jurisdiction

deepset (Haystack) leads with 5/5 vs 2/5.

●deepset (Haystack) (5/5): German GmbH, fully under EU law. Berlin headquarters. No US parent company. Investors include EU and US VCs but corporate governance remains German.

●Portkey (2/5): Delaware incorporation. US jurisdiction. Self-hosted option eliminates cloud dependency for data-sensitive deployments.

#### Data Retention & Training

Both score equally at 4/5.

●deepset (Haystack) (4/5): Terms restrict data use to anonymised system data only. No explicit public 'we don't train' statement, but contractual restrictions are clear. Self-hosted gives full control.

●Portkey (4/5): Gateway does not train on routed data. Observability logs are retained per customer policy. Self-hosted gives full control.

#### Certifications

deepset (Haystack) leads with 5/5 vs 3/5.

●deepset (Haystack) (5/5): SOC 2 Type II, ISO 27001, HIPAA, and CSA STAR Level 1. Comprehensive certification suite for enterprise procurement. Third-party DPO (secjur).

●Portkey (3/5): SOC 2 Type II certified. Appropriate for the company's stage. ISO 27001 would strengthen enterprise procurement.

#### Regulatory Fit

deepset (Haystack) leads with 5/5 vs 3/5.

●deepset (Haystack) (5/5): German GmbH with EU hosting, self-hosting option, and strong certifications. One of the best-positioned AI developer tools for EU regulated industries including financial services and healthcare.

●Portkey (3/5): Self-hosted option enables EU deployment. SOC 2 certified. US jurisdiction applies to cloud product. Suitable for European teams managing multi-model AI infrastructure.

Certifications at a Glance

Certification	deepset (Haystack)	Portkey
CSA STAR Level 1	Yes	No
ISO 27001	Yes	No
SOC 2 Type II	Yes	Yes

Overall Verdict

deepset (Haystack) has a clear trust advantage, scoring 24/25 compared to Portkey's 15/25. deepset (Haystack) particularly excels in data residency, legal jurisdiction, certifications, regulatory fit.

Frequently Asked Questions

Which is better for EU compliance, deepset (Haystack) or Portkey?

deepset (Haystack) has a TrustKit score of 24/25 while Portkey scores 15/25. deepset (Haystack) currently rates higher across data residency, legal jurisdiction, data retention, certifications, and regulatory fit.

How do deepset (Haystack) and Portkey compare on data residency?

deepset (Haystack) scores 5/5 for data residency (EU hosting available for managed platform. On-premises and air-gapped deployments fully supported. Open-source framework runs entirely locally with zero external data flow.), while Portkey scores 3/5 (US cloud by default but self-hosted deployment option allows EU data residency. Gateway architecture means LLM requests can be routed to EU-hosted providers.).

Are deepset (Haystack) and Portkey GDPR compliant?

Both tools are assessed across five compliance dimensions. deepset (Haystack) has a regulatory fit score of 5/5 and Portkey scores 3/5. Check the full comparison above for a detailed breakdown.

Explore Each Tool