Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wildfire update #126

Open
wants to merge 25 commits into
base: main
Choose a base branch
from
Open

Wildfire update #126

wants to merge 25 commits into from

Conversation

Vedant1
Copy link
Collaborator

@Vedant1 Vedant1 commented Nov 27, 2024

  • created get_abstractions and update_abstractions functions in core.py for user to access the abstraction after using a plugin reader -- useful for existing examples
  • updated csv reader/writer to use abstraction not pass through functions
  • commented out several pass through functions in sqlite.py and file_reader.py
  • updated test_sqlite.py to use newer sqlite functions -- no pass throughs
  • updated all plugin readers to handle mismatched columns from several data files in same ingest (ex: results.toml and results1.toml)
  • updated sqlite to handle mismatched columns for same table from different ingests to the sqlite db
  • moved core functions around so plugin readers called when loaded, and only plugin writers require transload()
  • no more transload lock anymore
  • specified which function produces an error in error messages -- for user clarity
  • updated wildfire and pennant examples to use DSI abstraction layer and new core functions/workflow
  • updated examples.rst to use correct sqlite functions and updated pennant example
  • updated dsi_units table in sqlite db write and read to separate col_name and units into two columns not one

Vedant P Iyer and others added 25 commits November 15, 2024 19:45
… and get_artifacts can return an orderedDict now
…ed by plugin writers, specified error locations in artifact_handler
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants