Verify integrated ingest api in staging and reconcile collection metadata

[anayeaye]

What

The integrated ingest-api has been promoted to the staging stack. Use the support script to run the ingest-api/collections endpoint to update the collections in the staging database without causing any existing collection summaries to be removed.

Refs

• NEW API ingestor_staging_url="https://staging-ingest.delta-backend.com"
• Support script collection-metadata-reconciliation.ipynb
• Support script to reconcile all collection metadata #98

AC

Note:
Because this change could impact downstream dashboards, it is a good candidate for a paired project executed during a maintenance window

• verify that new integrated ingest api is properly publishing collection metadata
• dry run update staging metadata
• update staging collections

[slesaad]

Updates need to be promoted to staging for new ingest fixes.

[botanical]

Dry run testing

Ran a dry run using the mcp-test backend stack which has a snapshot of the UAH staging db

Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-lst-night-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/OMI_trno2-COG
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-tws
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Processing
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-shdi-raster
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/conus-reach
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B1a_Coal_Mining_Underground
An error occurred for collectionId ndvi_diff_Ian_2022-09-30_2022-09-05: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ndvi_diff_Ian_2022-09-30_2022-09-05
An error occurred for collectionId entropy_difference_2022-09-05_2022-09-30: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/entropy_difference_2022-09-05_2022-09-30
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-median-585
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-socioeconomic
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4B_Manure_Management
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/geoglam
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/OMSO2PCA-COG
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-tws-trend
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_2B5_Petrochemical_Production
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Production
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/facebook_population_density
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tws-nonstationarity-index
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-albedo-wsa-diff-2015-2022
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-overall
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ceos-co2-flux-budgets-mean
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-v1-raster
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6A_Landfills_Industrial
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6B_Wastewater_Treatment_Domestic
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-median-245
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6D_Composting
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ecco-surface-height-change
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-l30-002-ej-reprocessed
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-aod
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ls8-covid-19-example-data
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/IS2SITMOGR4-cog
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-bais2-v2
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/recovery-proxy-maps-covid-19
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-swe
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_2C2_Ferroalloy_Production
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-ndvi-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-gpp-trend
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nightlights-500m-daily
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4A_Enteric_Fermentation
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/eis_fire_newfirepix
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/barc-thomasfire
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/cygnss-watermask-ucar
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nightlights-hd-1band
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-cdr-raster
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-lst-night-diff-2015-2022
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-gpp
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-evap
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-lst-day
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-antarctic-glaciers-pine-island
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/cygnss-watermask-ucberkeley
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_1B2b_Natural_Gas_Production
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-qs
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-qsb
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/blue-tarp-planetscope
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-aral-sea
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/damage_probability_2022-10-03
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/caldor-fire-burn-severity
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-lst-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/co2-mean
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nceo_africa_2017
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-vnl-slope-raster
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/disturbance-probability-percentile
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-tonle-sap
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/disalexi-etsuppression
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-overall-nopop
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-aod-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_1A_Combustion_Stationary
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nightlights-hd-monthly
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-household-nopop
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/slowdown-proxy-covid-19-changing-landscapes
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-daily-emissions_5_Forest_Fires
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ceos-co2-flux-budgets
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/eis_fire_fireline
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6A_Landfills_Municipal
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-landcover
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/frp-max-thomasfire
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-minority
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-imr-raster
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-lake-balaton
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-fire-anomalies-diff-covid-19-changing-landscape
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-nighttime-thermal
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Transmission
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-totalprecip
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6B_Wastewater_Treatment_Industrial
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-bais2
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tws-anomaly
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2a_Petroleum
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_4F_Field_Burning
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP585-winter-median-ta
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_5_Forest_Fires
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-vnl-raster
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-diff-245
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-nlcd
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Distribution
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/togo-agriculture-covid-19
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-diff-585
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-ndvi
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/eis_fire_perimeter
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP245-winter-median-ta
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-albedo-wsa-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-lst-night
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/co2-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/blue-tarp-detection
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-etsuppression
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B1a_Coal_Mining_Surface
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/caldor-fire-behavior
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tvegsuppression
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-annual-lai-2003-2020
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1A_Combustion_Mobile
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-s30-002-ej-reprocessed
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_4B_Manure_Management
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-streamflow
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/pzd-anomaly-covid-19
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-urbanization
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-housing
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-lst-day-diff-2015-2022
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-ndvi
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis_diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-vanern
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-gws
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/no2-monthly-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP245-winter-median-pr
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1A_Combustion_Stationary
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-socioeconomic-nopop
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-antarctic-glaciers-thwaites
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/bangladesh-landcover-2001-2020
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/mtbs-burn-severity
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4C_Rice_Cultivation
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-lake-biwa
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_1B2a_Petroleum
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/MO_NPP_npp_vgpm
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/fldas-soil-moisture-anomalies
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-ndvi-diff-2015-2022
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B1a_Abandoned_Coal
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/no2-monthly
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/oco2-geos-l3-daily
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-housing-nopop
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tws-trend
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/sport-lis-vsm0_100cm-percentile
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_4C_Rice_Cultivation
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-minority-nopop
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-household
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-filled-missing-values-count
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-swir-falsecolor-composite
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/combined_CMIP6_daily_GISS-E2-1-G_tas_kerchunk_DEMO
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-v1-built
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4F_Field_Burning
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-lst-day-diff
Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP585-winter-median-pr

You'll notice there are two errors, likely because those collections don't exist. Anyone know how I can remedy that?

An error occurred for collectionId ndvi_diff_Ian_2022-09-30_2022-09-05: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ndvi_diff_Ian_2022-09-30_2022-09-05
An error occurred for collectionId entropy_difference_2022-09-05_2022-09-30: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/entropy_difference_2022-09-05_2022-09-30

cc @anayeaye @slesaad @smohiudd

[botanical]

After input from Saadiq on slack, we'll only reconcile what exists in staging. I think then that reconciliation is good to go for early next week for "production" (staging on UAH) given that the dry run resolved the invalid STAC item issues (the invalid null values were removed or reconciled - see above links for proof).

[botanical]

Ran the notebook against staging this afternoon with support from @smohiudd (thanks!!) 🙇‍♀️

We verified the following:

• Browser looks good
• Dashboard
  • Specifically checked the catalog, stories, and did some analysis
  • Generally, analysis looks good with the exception of some like "Stream network across the Contiguous United States" but it's apparently related to this issue we haven't yet addressed: Investigate statistics endpoint under analytics load veda-backend#290

Started a spreadsheet to record when we run collection metadata reconciliation https://docs.google.com/spreadsheets/d/1ygIOPrFJ6mgslfVrIFP6ln_-xn2CCELmXBof4aA6BR4/edit?usp=drive_link