Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Basic html loader with crawly #22

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Commits on Oct 14, 2023

  1. Pulling latest from brainlid (#1)

    * adding readme function overview image
    
    * updated image
    
    * fixing image alt text
    
    * centering image?
    
    * reduced image
    
    * tweak image url for cache busting
    
    * rename image to update
    
    * chat chain logo image
    
    * added logo image
    
    * logo-32px
    
    * don't commit graphic sources
    
    * graphic updates
    
    * fixed spelling
    
    * cleanup the configuration README
    
    * make chatgpt response tests more robust
    
    Even when given specific instructions like "Return the response 'Hi'."
    ChatGPT (and LLMs in general) don't always follow the
    instructions *exactly* (for example, ChatGPT will often respond to the above
    prompt with "Hi!").
    
    As a result, equality testing on the response makes for flaky tests. This change
    keeps the test prompts, but instead matches on the responses with `=~`. Still
    not perfect, but less likely to be flaky, which in tests seems like a win.
    
    * link to demo project
    
    * add "update_custom_context" to LLMChain
    - added tests
    
    * add support for setting the `OpenAI-Organization` header in requests to the OpenAI API
    
    * set pattern match in `DataExtractionChain` to look for `role: :assistant` as it appears to be the only valid result at this stage
    
    * improved the data extraction prompt
    - didn't consistently handle 'null' values
    
    * update readme
    - add example of openai_org_id config
    
    * improve pattern match on data extraction chain
    
    * update version
    
    * updated changelog
    
    * put "Elixir" in the Readme title
    
    ---------
    
    Co-authored-by: Mark Ericksen <brainlid@gmail.com>
    Co-authored-by: Ben Swift <ben@benswift.me>
    Co-authored-by: Adam Mokan <amokan@gmail.com>
    4 people authored Oct 14, 2023
    Configuration menu
    Copy the full SHA
    2cd1f79 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. Document struct and Crawly Document Loader

    Warner Onstine committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    7352ac7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a679613 View commit details
    Browse the repository at this point in the history