Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hey omi, using the device's programmable button #1399

Merged
merged 1 commit into from
Nov 26, 2024
Merged

Conversation

beastoin
Copy link
Collaborator

@beastoin beastoin commented Nov 24, 2024

Issue: #1388

Feature

  • "hey omi" should be triggered with a long press of the button on the omi device and the query should be collected while the user is holding the button.
  • turnon/turnoff of the device should be switched to short click
  • after the button is released, we send the question/prompt to LLM, while passing all {facts} and {conversations/memories}, chat history and current conversation
  • 4 the answer should be shown in the chat and sent via notification

Usages

  • Long press to start the voice command (as a message for now), you will feel the haptic feedback
  • Release to send it, then wait for Omi's response.
  • To turn the device on / off, use a single tap

TODOs

  • "hey omi" should be triggered with a long press of the button on the omi device and the query should be collected while the user is holding the button.
  • turnon/turnoff of the device should be switched to short click
  • after the button is released, we send the question/prompt to LLM, while passing all {facts} and {conversations/memories}, chat history and current conversation
  • 4 the answer should be shown in the chat and sent via notification
  • firmware: fix the button changes not notify sometime -> implement the haptic then control it from the app + add new issue for firmware fixes: Programmable button misses its state, sometime #1412

Deploy plan

  • deploy backend
  • deploy firmware
  • deploy mobile app

@@ -272,20 +288,22 @@ void check_button_level(struct k_work *work_item)
if (inc_count_1 > threshold)
{
notify_long_tap();
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

check why we need this second notify logic

app/lib/providers/capture_provider.dart Outdated Show resolved Hide resolved
app/lib/services/devices/device_connection.dart Outdated Show resolved Hide resolved
app/lib/services/devices/models.dart Outdated Show resolved Hide resolved
app/lib/services/notifications.dart Outdated Show resolved Hide resolved
backend/routers/chat.py Outdated Show resolved Hide resolved
app/lib/providers/capture_provider.dart Show resolved Hide resolved
@beastoin beastoin changed the title . Hey omi with the device's programmable butt on Nov 25, 2024
@beastoin beastoin changed the title Hey omi with the device's programmable butt on Hey omi with the device's programmable button Nov 25, 2024
@beastoin beastoin marked this pull request as ready for review November 25, 2024 22:50
@beastoin beastoin changed the title Hey omi with the device's programmable button Hey omi, using the device's programmable button Nov 25, 2024
@beastoin beastoin merged commit 7fbc394 into main Nov 26, 2024
@beastoin beastoin deleted the eukst_hey_omi_1388 branch November 26, 2024 02:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant