Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feast integration #16

Open
sarahwooders opened this issue Dec 1, 2021 · 4 comments
Open

Feast integration #16

sarahwooders opened this issue Dec 1, 2021 · 4 comments
Assignees

Comments

@sarahwooders
Copy link
Contributor

sarahwooders commented Dec 1, 2021

Write updates (inserts/deletes) into the Feast online and offline stores.

This could potentially be implemented by reading the providers in the Feast config file and writing to them directly. e.g.

from ralf import Ralf, FeastConnector 

ralf = Ralf()
connector = FeastConnector(config="feature_store.yaml") # read providers and connect
@narang-amit
Copy link
Collaborator

Should the same table be allowed to have multiple connectors? e.g. one table should be stored in Feast and in Redis or something?

@simon-mo
Copy link
Collaborator

simon-mo commented Jan 21, 2022

Should the same table be allowed to have multiple connectors?

This but it should be implemented in a layer above. Something like:

connector = MultiplexingConnect([FeastConnector(), RedisConnector()])

@narang-amit
Copy link
Collaborator

Why that approach over TableState(schema, List[Connector])? @simon-mo

@simon-mo
Copy link
Collaborator

Abstractions. Now table only cares about writing to a single connector and it's kept simple.

@narang-amit narang-amit self-assigned this Feb 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants