# Microsoft Fabric Spark Job Definition Documentation

> **Note:** This documentation is mandatory for all production Spark job definitions.
> Irrelevant chapters may remain empty but must not be removed. Automatically
> filled fields come from the Microsoft Fabric service; fields marked
> _"To be completed"_ must be completed manually.

---

## 1. Metadata

| Field | Value |
|-----|------|
| Spark job definition name | {{SJ_Name}} |
| Description | {{SJ_Beschreibung}} |
| Spark job definition ID | {{SJ_ID}} |
| Web URL | {{SJ_WebUrl}} |
| Language | {{SJ_Language}} |
| Executable file | {{SJ_ExecutableFile}} |
| Main class | {{SJ_MainClass}} |
| Default lakehouse | {{SJ_DefaultLakehouse}} |
| Created / configured by | {{SJ_ConfiguredBy}} |
| Last modified | {{SJ_ModifiedTime}} |
| Business unit | {{SJ_Fachbereich}} |
| Corporate domain | {{SJ_Konzerndomaene}} |
| Current version | 1.0 |
| Status | Production |
| Last updated | {{SJ_ExportDatum}} |

---

## 2. Contacts & Responsibilities

| Role | Name / Team | Contact |
|-----|-------------|--------|
| Business owner | {{KONTAKT_BusinessOwner}} | {{KONTAKT_BusinessOwnerMail}} |
| Technical owner | {{KONTAKT_TechOwner}} | {{KONTAKT_TechOwnerMail}} |
| Data steward | {{KONTAKT_DataSteward}} | {{KONTAKT_DataStewardMail}} |
| Operations / Support | {{KONTAKT_Betrieb}} | {{KONTAKT_BetriebMail}} |

---

## 3. Business Goal & Context

### 3.1 Objective
{{SJ_Zielsetzung}}

### 3.2 Business Use Case
{{SJ_Anwendungsfall}}

### 3.3 Downstream Consumers (pipelines / lakehouses)
{{SJ_Konsumenten}}

---

## 4. Structure & Configuration

### 4.1 Execution Configuration

{{SJ_KonfigTabelle}}

### 4.2 Additional Libraries

{{SJ_BibliothekenTabelle}}

---

## 5. Data Sources & Loading

### 5.1 Data Sources / Processed Objects

{{SJ_DatenquellenTabelle}}

### 5.2 Detailed Description per Data Source
{{SJ_DatenquellenDetail}}

---

## 6. Content & Usage

{{SJ_ServiceHinweis}}

### 6.1 Execution Logic
{{SJ_LogikHinweis}}

### 6.2 Parameters & Arguments
{{SJ_ParameterHinweis}}

### 6.3 Data Quality

- Error handling: {{SJ_NullHandling}}
- Data validation rules: {{SJ_Validierungsregeln}}
- Retention / historization: {{SJ_Aufbewahrung}}

### 6.4 Performance Notes

- Resources / optimization: {{SJ_Optimierung}}
- Known performance bottlenecks: {{SJ_PerformanceHinweise}}
- Further measures: {{SJ_Optimierungen}}

---

## 7. Operations & Maintenance

### 7.1 Execution & Orchestration

{{SJ_Beladung}}

### 7.2 Monitoring & Error Handling
{{SJ_Monitoring}}

### 7.3 Known Issues / Technical Debt
{{SJ_BekannteProbleme}}

---

## 8. Security & Permissions

### 8.1 Access & Sharing
{{SJ_Zugriffe}}

### 8.2 Sensitivity Labels
{{SJ_Labels}}

### 8.3 Risks & Limitations
{{SJ_Risiken}}

---

## 9. Versioning & Change History

### 9.1 Repository / Storage
{{SJ_Repository}}

### 9.2 Change Log

| Version | Date | Change | Type (business/technical) | Author |
|-------|-------|---------|--------------------------|-------|
| 1.0 | {{SJ_ExportDatum}} | Automatic initial documentation | technical | Auto documentation |

---

## 10. Approval & Review

| Role | Name | Date | Comment |
|-----|------|-------|----------|
| Business | {{REVIEW_FachName}} | {{REVIEW_FachDatum}} | {{REVIEW_FachKommentar}} |
| Technical | {{REVIEW_TechName}} | {{REVIEW_TechDatum}} | {{REVIEW_TechKommentar}} |

---

## 11. Appendices & References
- Parent workspace documentation
- Architecture diagrams
- Regulatory evidence (separate)
