diff --git a/app/components/dashboard/audit_information_component.html.erb b/app/components/dashboard/audit_information_component.html.erb index a506ffc96..2c44a9e53 100644 --- a/app/components/dashboard/audit_information_component.html.erb +++ b/app/components/dashboard/audit_information_component.html.erb @@ -12,9 +12,9 @@ Note also: - - + @@ -23,50 +23,50 @@ Note also: - + - - + + - - + - - + + - - + - - + + - - + - - - + + + - + - - - - - + + + + + - +
+ redis queue nameexpected frequency
(from app/config/schedule.rb)
expected frequency
(from app/config/schedule.rb)
how many objects get queued objects with audit timestamps older than threshold objects with errors
Validate Moab
moab-versioning gem validation for well-formedness (not checksums) run for locally stored Moabs.
Validate Moab
moab-versioning gem validation for well-formedness (not checksums) run for locally stored Moabs.
validate_moab on demandone:
queued by preservation robot step after updating a Moab
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
one:
queued by preservation robot step after updating a Moab
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
<%= num_moab_record_not_ok %> +
Moab to Catalog
moab-versioning gem validation for well-formedness (not checksums) run for locally stored Moabs and verified against database info.
Moab to Catalog
moab-versioning gem validation for well-formedness (not checksums) run for locally stored Moabs and verified against database info.
m2c Monthly: 11 am on the 1st of every monthall:
queued by walking directories on MoabStorageRoot.storage_location
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
all:
queued by walking directories on MoabStorageRoot.storage_location
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
<%= num_moab_record_not_ok %> +
Catalog to Moab
Database info verified against locally stored Moabs and moab-versioning integrity checks for Moabs.
Catalog to Moab
Database info verified against locally stored Moabs and moab-versioning integrity checks for Moabs.
c2m Monthly: 11 am on the 15th of every monthall:
queued by associated MoabStorageRoot
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
all:
queued by associated MoabStorageRoot
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
<%= num_moab_record_not_ok %> +
Checksum Validation (CV)
Compare checksums in Moab metadata files on local storage with computed checksums for Moab metadata and content files.
Checksum Validation (CV)
Compare checksums in Moab metadata files on local storage with computed checksums for Moab metadata and content files.
checksum_validationWeekly: 1am on Sunday
for MoabRecords with expired checks
subset:
expired checksums queued by associated MoabStorageRoot
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
Weekly: 1am on Sunday
for MoabRecords with expired checks
subset:
expired checksums queued by associated MoabStorageRoot
Moab audits older than <%= moab_audit_age_threshold %>:
<%= num_moab_audits_older_than_threshold %>
<%= MoabRecord.invalid_checksum.count %><%= num_moab_expired_checksum_validation %>

(passing checks expire 90 days after they are run)
<%= num_moab_expired_checksum_validation %>

(passing checks expire 90 days after they are run)
Catalog to Archive
Confirm a PreservedObject has all versions/parts replicated for each of its target endpoints and attempts to backfill missing ones
moab_replication_audit
part_audit_aws_s3_east_1
part_audit_aws_s3_west_2
part_audit_ibm_us_south
Weekly: 12am on Wednesday
for PreservedObjects with expired checks
subset:
expired archive checks for PreservedObjects and their associated ZipParts are queued
PreservedObject replication audits older than <%= replication_audit_age_threshold %>:
<%= num_replication_audits_older_than_threshold %>
Catalog to Archive
Confirm a PreservedObject has all versions/parts replicated for each of its target endpoints and attempts to backfill missing ones
moab_replication_audit
part_audit_aws_s3_east_1
part_audit_aws_s3_west_2
part_audit_ibm_us_south
Weekly: 12am on Wednesday
for PreservedObjects with expired checks
subset:
expired archive checks for PreservedObjects and their associated ZipParts are queued
PreservedObject replication audits older than <%= replication_audit_age_threshold %>:
<%= num_replication_audits_older_than_threshold %>
<%= num_replication_errors %><%= PreservedObject.archive_check_expired.count %>

(passing checks expire 90 days after they are run)
<%= PreservedObject.archive_check_expired.count %>

(passing checks expire 90 days after they are run)
- \ No newline at end of file + diff --git a/app/components/dashboard/audit_status_component.html.erb b/app/components/dashboard/audit_status_component.html.erb index 1fc1921bc..e5d234dc5 100644 --- a/app/components/dashboard/audit_status_component.html.erb +++ b/app/components/dashboard/audit_status_component.html.erb @@ -57,4 +57,4 @@ - \ No newline at end of file + diff --git a/app/components/dashboard/moab_records_component.html.erb b/app/components/dashboard/moab_records_component.html.erb index e855e93d2..d41566ac9 100644 --- a/app/components/dashboard/moab_records_component.html.erb +++ b/app/components/dashboard/moab_records_component.html.erb @@ -7,8 +7,8 @@ count total size average size - <%status_labels.map do |status| %> - <%=status %> + <% status_labels.map do |status| %> + <%= status %> <% end %> expired checksum audit diff --git a/app/components/dashboard/moab_storage_roots_component.html.erb b/app/components/dashboard/moab_storage_roots_component.html.erb index 9c34cdd8e..eb847b903 100644 --- a/app/components/dashboard/moab_storage_roots_component.html.erb +++ b/app/components/dashboard/moab_storage_roots_component.html.erb @@ -13,7 +13,7 @@ average size moab count <% status_labels.map do |status| %> - <%=status %> + <%= status %> <% end %> expired checksum audit @@ -39,9 +39,9 @@ totals - - - + + + <%= storage_roots_moab_count %> <%= storage_roots_ok_count %> <%= storage_roots_invalid_moab_count %> diff --git a/app/components/dashboard/object_versions_component.html.erb b/app/components/dashboard/object_versions_component.html.erb index 95e0be902..296d65216 100644 --- a/app/components/dashboard/object_versions_component.html.erb +++ b/app/components/dashboard/object_versions_component.html.erb @@ -4,7 +4,7 @@ - diff --git a/app/components/dashboard/replication_endpoints_component.html.erb b/app/components/dashboard/replication_endpoints_component.html.erb index f6568b1b0..a9abec6fb 100644 --- a/app/components/dashboard/replication_endpoints_component.html.erb +++ b/app/components/dashboard/replication_endpoints_component.html.erb @@ -8,8 +8,8 @@ - - + + @@ -25,4 +25,4 @@
+ count object version count highest version
endpoint name ActiveJob class for replicationZippedMoabVersion replicated count
(according to database)
Number of Object Versions
(per PreservedObject)
ZippedMoabVersion replicated count
(according to database)
Number of Object Versions
(per PreservedObject)
- \ No newline at end of file + diff --git a/app/components/dashboard/replication_files_component.html.erb b/app/components/dashboard/replication_files_component.html.erb index a3719a055..2e81530ba 100644 --- a/app/components/dashboard/replication_files_component.html.erb +++ b/app/components/dashboard/replication_files_component.html.erb @@ -22,4 +22,3 @@ - diff --git a/app/views/dashboard/_audit_info.html.erb b/app/views/dashboard/_audit_info.html.erb index 490442e0e..075212df7 100644 --- a/app/views/dashboard/_audit_info.html.erb +++ b/app/views/dashboard/_audit_info.html.erb @@ -1,3 +1,3 @@ <%= render Dashboard::AuditInformationComponent.new %> - \ No newline at end of file + diff --git a/app/views/dashboard/_moab_information.html.erb b/app/views/dashboard/_moab_information.html.erb index f523eadf4..6de994ed3 100644 --- a/app/views/dashboard/_moab_information.html.erb +++ b/app/views/dashboard/_moab_information.html.erb @@ -1,15 +1,15 @@

Moabs on Storage - Status Information

PreservedObject records store the druid and links to db records about both the Moab on local storage and all the replicated instances in the cloud.

MoabRecord records are about the Moab on storage.

-
+
<%= render Spinner.new %> -
+
<%= render Spinner.new %> -
+
<%= render Spinner.new %> diff --git a/app/views/dashboard/_replication_information.html.erb b/app/views/dashboard/_replication_information.html.erb index 4974a3ff7..68264448c 100644 --- a/app/views/dashboard/_replication_information.html.erb +++ b/app/views/dashboard/_replication_information.html.erb @@ -6,12 +6,12 @@

ZippedMoabVersion records are about a single version of the Moab that is archived as zip file(s) on a particular cloud endpoint.

ZipPart records represent the individual zip segments for a ZippedMoabVersion (zips larger than <%= Replication::DruidVersionZip::ZIP_SPLIT_SIZE %> are split into segments) that are replicated to the particular cloud endpoint.

See Replication Flow wiki for details about the replication process.

-
+
<%= render Spinner.new %> -
+
<%= render Spinner.new %> -
+
diff --git a/app/views/dashboard/index.html.erb b/app/views/dashboard/index.html.erb index 88f3435d1..1f16f2a00 100644 --- a/app/views/dashboard/index.html.erb +++ b/app/views/dashboard/index.html.erb @@ -20,7 +20,7 @@ -
+