raw_crs_harvest_monitor¶
Info¶
Data contract for the CRS Harvest Monitor data from the landing zone into raw. - name: CRS Harvest Monitor - version: 0.0.4 - status: active
Terms of Use¶
Purpose¶
Data contract for the CRS Harvest Monitor data from the landing zone into raw.
Servers¶
| Name | Type | Attributes |
|---|---|---|
| production | databricks | No description. • environment: production • roles: [{'role': 'Admins', 'description': 'Access to all the data and settings'}] • catalog: raw_production • host: dbc-2030845a-6c3b.cloud.databricks.com • schema_: crs |
| development | databricks | No description. • environment: development • roles: [{'role': 'Admins', 'description': 'Access to all the data and settings'}] • catalog: raw_development • host: dbc-03ed8bbb-c0ec.cloud.databricks.com • schema_: crs |
Schema¶
harvest_monitor¶
Table storing the harvest monitor data in the raw layer of the Biocloud.
| Field | Type | Attributes |
|---|---|---|
| id | bigInt | Unique identifier of the harvest monitor record • primaryKey• primaryKeyPosition: 1 |
| datum | string | numbered representation of the date the warning was created (20260113) |
| harvestsessionid | bigInt | Identifier for the harvest session generated by the medialib harvester |
| melding | string | description of the exact problem the harvester encountered |
| tijd | string | the timestamp of the exact time the warning was generated (13:05:11) |
| harvestsource | string | name of the harvestsource (for example "Paleontologie" or "DNALab") |
| inserted_ts_utc | timestamp | UTC timestamp when record was inserted |
| updated_ts_utc | timestamp | UTC timestamp when record was last updated |