chore(main): release 0.13.0

[github-actions]

🤖 I have created a release beep boop

0.13.0 (2024-11-27)

Features

• able to insert without postgres, able to get it to search (54b7771)
• able to update parameters, not able to see the changes in the (44b1067)
• add tag_regexes parameter to add more metadata as a (e10b9bd)
• add additional debugging logs to bulk upload for ingest worker (869166f)
• add advanced options and usage metrics to each chunk (9c9596d)
• add api key functionality to demo-ui app (ff00e25)
• add api key params and expiration (22b84f1)
• add batch create dataset route (c141890)
• add CI workflow to push images for pdf2md service (bb88f91)
• add CLI to test pdf chunking (2543b28)
• add close button (879aa1f)
• add docker-compose.yml for local testing (bee90ab)
• add errors into prometheus /metrics scrape (807ff8c)
• add example and update adapter to work (5fc58fb)
• add fall back response if there is no chunks above the score threshold (ba8b5d7)
• add file chunker microservice (86fec6c)
• add flag to enable pdf2md (322ec12)
• add health check + fix redoc (c5e6e18)
• add json toggle + copy button to pdf2md (f898cb5)
• add logging and write to clickhouse (858df03)
• add max req time so we don't stall out workers ever (7fe1a49)
• add navbar to public page (0fa9748)
• Add new advanced settings to backend page.html and page handler (66ac2a0)
• add new parameter for making qdrant collections (dc6f5d1)
• add open in new window button for public page (a43c57d)
• add organization_id header when possible to all API reqs (05e4099)
• add other props to advanced settings (66ac2a0)
• add page right after its been processed (11623e0)
• add QDRANT_ONLY to dataset configuration (de775d2)
• add route to get message by id (e7a061c)
• add skeleton template others can slot into (a97e793)
• add sort to search over groups (8bfdd76)
• add styles import (982fb56)
• add support for subtrace version b134 (71f01e0)
• add table for tracking tasks (0ee9ebc)
• add tag_regexes flag into the frontend (6fdd764)
• add token usage to pdf2md ui (a92b764)
• add type + groupSearch as options to public page config (213252b)
• add user routes to ts-sdk and tests (7518c52)
• add webhooks (93c865b)
• added api key and file chunking status (1a720a6)
• adding tags to rag (681b5bb)
• all done except logic to handle whether it's 0 or 1 indexed (f1c1c35)
• allow serialization of extra_params (aa7a44b)
• better chat button placement (45d5385)
• better error message for average vector strategy (4550234)
• better tooltip component (2f81c38)
• build metadata strings (46d1bba)
• bulk delete chunks (e65889a)
• completed MVP implementation of the UI (c8f93f3)
• correct polling + clicking view does something (215451c)
• custom date picker for analytics overview (591bada)
• default to useGroupSearch for public page on shopify datasets (e82c65b)
• different prompt (46d1bba)
• display all search parameters on the component page (10af639)
• docker setup for pdf2md service (75d0896)
• don't let workers run migrations (6f0bad3)
• dropdown menu for OpenAI/OpenRouter in LLM settings (b5b2a4b)
• ecomm component grid layout + padding (4a165e1)
• enable chunk bulk delete as an async operation where chunks matching delete filter can be inserted safely after resp (ba19f02)
• examples + drag and drop fle functionality (b6a2d1f)
• export TrieveDocument (5bdcad5)
• expose custom html based splitter (c7f8b9b)
• extract chunk_html from payload field, need to extract other (65aca1e)
• fast load public page (4ba4aea)
• file-worker to poll and get all chunks (d2d1a83)
• finish implementing QDRANT_ONLY mode with chunk_count and clear (0eee2f8)
• finished navbar for pdf2md (6489b08)
• fix image cropping (46d1bba)
• fix new dataset modal tooltip sizes (81c4759)
• fix styling for key command navigation (fc5db95)
• get signed url for pdf (44e3787)
• group chat image carousel (c63e09e)
• group parsing and ui (41f6088)
• group search view starter for ecommerce, show price range of items (74800eb)
• handle first load in of table (c9576c8)
• implement hero background customization (2ebfb92)
• include advanced options form for pdf2md (29451a5)
• include cost estimate on pdf view (eec0b1e)
• include organization url in invitation email (37ef206)
• include tables (46d1bba)
• include user resource in ts-sdk docs (2c5a345)
• initialize logger on clone qdrant script (a13f1de)
• integrate chunkr as a provider for markdown conversion (afeab01)
• jinja template to render the all component properties (e3aef3e)
• join similar groups together based on product.title (9651e40)
• make BATCH_CHUNK_LIMIT an env to increase it past 120 for (48d772b)
• make footer look better (1682f3b)
• make pdf2md ocr optional (1f655cf)
• make shopify scraping handle null valeus in products.json, fix (f9e0f5b)
• manual rag with groups (dbe62ad)
• move pdla types (46d1bba)
• multistring input for default questions (e4abc63)
• new system prompt (46d1bba)
• open the search component by default (98d1d21)
• page parameters viewable on the search page, initial styling (7747182)
• pdf to md :) (89d7020)
• pdf2md: make LLM provider be the default chunking provider (a2fdbfe)
• pdf2md: make remove items from processing after message is (4e92c58)
• pdf2md: update all docker images to have poppler (0e520f4)
• process 1 page at a time (bbb9d67)
• public page back button (7dcb165)
• public page settings tooltips (2dfd91c)
• queue shopify chunks as you go (247decc)
• rearrange images to display horizontally and make the section collapsable (934e3a6)
• remove description on groups view in favor of Chunk Count on (e06f169)
• route to get number of chunks in a group with /api/chunk_group/count (ddb7efc)
• save chunk boost values to postgres (6dea41c)
• scope api keys to orgs (a2e28fb)
• separate subpackage for vanilla js (298318b)
• set defualt values in search UI (3d35fd6)
• setup fileworker to communicate with pdf2md (2dfe5e5)
• shortcut to toggle component modes (2c4f378)
• skeleton for pdf2md demo page (edce843)
• skeleton upload form for pdf2md (85715a8)
• smaller search component package (6ff6c72)
• store hero background name and config (bdaf162)
• trieve fumadocs adapter (0c087fa)
• uniquify variants (52e3b0b)
• update chunk boosts (9cf609f)
• update fileworker to receive the correct response type (c30953e)
• update python SDK (2f9ba2d)
• update to new route name (5735ef8)
• update ts-sdk to include dataset routes (c94e26d)
• updates to frontend propagate correctly to the rendered (5811fd9)
• upgrade qdrant and use new search over groups query (ad89e4a)
• use api key filters for scroll and add scroll test (a76db38)
• use carousel for product items in chat (4b01233)
• use past messages for context (238fae0)
• use pdla boxes for chunking (46d1bba)
• use proper struct for public page options (a729c5f)
• version bump component to 0.0.64 (2f5a255)
• working API req on file form add (1eb1a52)
• working CSS for demo-ui on pdf2md (6eb7dba)

Enhacements

• improve organization email template (100b756)
• move number of retrievals for rag to llm settings (16e4cd3)
• send an event that scraping has started (e4f8e14)

Cleanup

• add .env.dist + use env's for model in pdf_chunk.rs (94fcb7f)
• better public page setting assert (064a84a)
• clippy (977580d)
• clippy and lint (d22dcf2)
• document how to change system prompt and other RAG settings in dashboard (25b65ea)
• ensure save button for dataset settings is visible (424b1f8)
• errant print in py sdk chunk_group_api (e090c00)
• fix rust formatting (ccc06d8)
• fixed mode switch on mobile such that it's on top-right with (3ac55e3)
• format and strip html from betterGroupName (8e1685c)
• formatting (fa633cd)
• load-in css animation for search component (0aa668a)
• move test program (46d1bba)
• remove creating a file on the file_handler (18930d5)
• remove credits_used from firecrawl + update env's (eefa854)
• remove deprecated direction prop for tooltip (9cd45f5)
• remove old search component syntax highlighted versions (a28e78f)
• remove red border (6e482bc)
• remove sentry (156392f)
• remove test binary (46d1bba)
• remove tracing and swap back to env_logger (4f041a5)
• slow down clone qdrant worker + add logs (30c4c7e)
• start carousel to the first page (2b09abc)
• temporarily remove subtrace for new builds to work (0102754)
• typo (370e0bd)
• update to latest Qdrant Rust SDK client (73f5254)
• use env's for search component example w/ local dev (74da050)

Bug Fixes

• add back working hero patterns (5d0c96b)
• add missing fields to PublicPageParameters struct (66ac2a0)
• change shortcut to ctrl-tab (66bbc6e)
• chat toggle mode not loading due to misplayzed lazy import of react-markdown (0277ef6)
• chunk routes on python SDK (2e5e3d4)
• clear chat when exiting single product chat (9646ffc)
• correct page count using redis (1bf67dc)
• default params for search component (2986d64)
• ecomm group search missing key + query suggestions not always loading on open (da86ea4)
• fix api key role not being set correctly (21c0d3e)
• fix broken Dockerfile, update subtrace version (bef55c2)
• fix peerDependencies (cb1ce2d)
• fixed bug when updating dataset settings (6361201)
• fumadocs: move trieve-ts-sdk to peerDeps, loosen version range (cfb56a6)
• group carousel image placement and clear chat (1a1f797)
• handle empty text better (46d1bba)
• hide repeated sizes (8dd4b34)
• hybrid search over groups is not properly returning the first chunk with a cross encoder score (746d04b)
• image lnik for README not rendering (12805ad)
• include snippet to handle loading env's at runtime instead of compile (a52308c)
• infinite refetch on public page settings (41b806c)
• initial pdf2js UI view tr missing some classes (4783d1b)
• issues after rebase (46d1bba)
• keep llm model in env (46d1bba)
• keep old api key if a new one is not provided (3f1c709)
• keep same tooltip size in shared ui (7a1f635)
• log errors into prom metrics (21dc391)
• make Dockerfile.worker to install poppler (3253c1c)
• make pdf2md bind to host port (5276259)
• make timeout error respond with json (2e71d44)
• mispelled "heading" (ca145a4)
• modal search position changing on height change + pre tags overflowing (8e14ae2)
• modify public page types to correct values (9345f17)
• move cta to far right (b2c0344)
• pdla server returns floats (46d1bba)
• prevent duplicate users in orgs (7ddb0d6)
• properly update chunk full-stop instead of only in Qdrant for (6b05342)
• public page code indent (beb5e51)
• python client search reqpayload (ebcd0e8)
• python SDK search within groups (16e1c59)
• restore chunk_html to only finding one heading per chunk (7babdaf)
• search component top position + transparent right arrow instead of hidden (993e835)
• search/ai queries not showing (c61da81)
• set 10ms timeout on key input to prevent double key press (23d25c4)
• set placeholder (8c1a0c0)
• skip first page of rendered images (da7d930)
• typo in tooltip (b903637)
• update bundler (c57520b)
• update version ranges to allow react 19 (a80291e)
• user test delete api key using key instead of id in user.test.ts for ts-sdk (1827bf7)
• working chat with groups (first message only) (2b6ff4d)
• wrong metatag title name for PDF2MD (9757d04)

Other

• create seperate docker-compose.yml files for dev and prod (f82f8d2)

Docs

• add vanilla js method (3c9234e)
• change style import example on public page (f2c8118)
• create k8s hosting guide (4a6fa27)
• include example for problemLink on search-component README (dc6b239)
• setup README with setup guide and hosting guide (7ba280b)
• Typo Fix (83f79dd)

Refactoring

• complete rename from file-chunker to pdf2md (a9eed78)
• remove task_id and change to id for simplicity of data model (6f899e3)

---

This PR was generated with Release Please. See documentation.