DH-5770 engine cleanup#480

Closed

DishenWang2023 wants to merge 911 commits intomainfrom ft/DH-5770-cleanup

This pull request is big! We're only showing the most recent 250 commits

Commits on May 7, 2024

DH-5136 POST PUT Database connection should not be multi-form (#336 )

jcjc712
authored and
DishenWang2023
committed
DH-5145 add csv export (#337 )
DishenWang2023
committed
DH-5146 added get finetuning list and modified optional fields in pos… (#338 )
DishenWang2023
committed
DH-5106 add finetunings page -- several kula updates/fixes

Juan Valacco
authored and
DishenWang2023
committed
DH-5152 fixed same display ids for multiple uploads (#339 )
DishenWang2023
committed
DH-5163 add sql to generation list (#340 )
DishenWang2023
committed
[Engine] Lastest changes Jan 4th (#341 )

jcjc712
authored and
DishenWang2023
committed
[Engine] Lastest changes Jan 5th (#342 )

jcjc712
authored and
DishenWang2023
committed
DH-5164 check db connection org (#343 )
DishenWang2023
committed
DH-5171 use engine GET for finetuning and table description (#345 )
DishenWang2023
committed
DH-5105 add api keys page and table

Juan Valacco
authored and
DishenWang2023
committed
DH-5171 made table description id optional (#346 )
DishenWang2023
committed
DH-5170 fixed slackbot response model (#347 )
DishenWang2023
committed
DH_5177 update submodule (#348 )
DishenWang2023
committed
DH-5172 - add API generation flow

Juan Valacco
authored and
DishenWang2023
committed
DH-5023 several ui fixes

Juan Valacco
authored and
DishenWang2023
committed
DH-5182 added fix when admin console uses instruction endpoint (#349 )
DishenWang2023
committed
[Engine] Lastest changes Jan 7th (#351 )

jcjc712
authored and
DishenWang2023
committed
[engine] latest bugfix

aazo11
authored and
DishenWang2023
committed
fixed prompt metadata (#352 )
DishenWang2023
committed
[BUG][Enterprise] fixed get table description with table_name (#353 )
DishenWang2023
committed
DH-5178 add api key revokin -- several ui fixes (#356 )

Juan Valacco
authored and
DishenWang2023
committed
DH-5023 add user list skeleton loading

Juan Valacco
authored and
DishenWang2023
committed
[BUG][Enterprise] Fix Get Generation not awaiting (#357 )
DishenWang2023
committed
DH-5188 hide tokens used (#355 )
DishenWang2023
committed
DH-5185 add refresh button to finetunings and api keys pages -- migrate refresh buttons to more minimalistic approach -- add success variant to api messages

Juan Valacco
authored and
DishenWang2023
committed
DH-5023 remove scroll and meke the api keys and finetunning list grow

Juan Valacco
authored and
DishenWang2023
committed
DH-5023 fix delete spacing for golden sqls

Juan Valacco
authored and
DishenWang2023
committed
[DH-5190] Recover upload file for Admin Console endpoint (#358 )

jcjc712
authored and
DishenWang2023
committed
DH-5023 fix remaining loading experiencies

Juan Valacco
authored and
DishenWang2023
committed
DH-5195 fix default golden sqls order (#359 )
DishenWang2023
committed
DH-5196 old db connection behavior (#360 )
DishenWang2023
committed
DH-5206 added timezone to datetime (#361 )
DishenWang2023
committed
DH-5197 fix playground stop generation flow

Juan Valacco
authored and
DishenWang2023
committed
DH-5204 update and fix naming and order of ssh settings for database connection form

Juan Valacco
authored and
DishenWang2023
committed
DH-5023 add disabled playground screen when no db connection is set

Juan Valacco
authored and
DishenWang2023
committed
DH-5023 use slack info field to hide slack message feature from query editor page

Juan Valacco
authored and
DishenWang2023
committed
DH-5206 updated submodule (#363 )
DishenWang2023
committed
Fixed foreign_key field in table description (#362 )
DishenWang2023
committed
Release lastest dataherald changes (#364 )

jcjc712
authored and
DishenWang2023
committed
DH-5180 -- add playground finetuning models select

Juan Valacco
authored and
DishenWang2023
committed
DH-5194 map query for the query editor page

Juan Valacco
authored and
DishenWang2023
committed
DH-5213 hide OpenAI API key from org settings to everyone

Juan Valacco
authored and
DishenWang2023
committed
DH-5170 fix slackbot by updating the slack installation endpoints urls

Juan Valacco
authored and
DishenWang2023
committed
DH-5193 fix showing confidence with 0 when it's null

Juan Valacco
authored and
DishenWang2023
committed
DH-5214 added handle for empty sql result (#365 )
DishenWang2023
committed
DH-5226 include finetuning alias (#366 )
DishenWang2023
committed
DH-5223 add none option to playground finetuning model select

Juan Valacco
authored and
DishenWang2023
committed
DH-5221 show error screen when server crashes for any reason

Juan Valacco
authored and
DishenWang2023
committed
Release lastest dataherald changes (#367 )

jcjc712
authored and
DishenWang2023
committed
DH-5235 remove sql result in GET (#369 )
DishenWang2023
committed
[DH-5240] Sync table depscriptions should return a list (#371 )

jcjc712
authored and
DishenWang2023
committed
DH-5241 update app state organization after setting up an org connection DB

Juan Valacco
authored and
DishenWang2023
committed
Release lastest dataherald changes (#377 )

jcjc712
authored and
DishenWang2023
committed
DH-5218 added better error handling for generations (#376 )
DishenWang2023
committed
DH-5210 several UI fixes and reorganization

Juan Valacco
authored and
DishenWang2023
committed
DH-5270 add support for table sorting -- aply on queries and golden sql pages for id and time columns

Juan Valacco
authored and
DishenWang2023
committed
DH-5271 add support for global table filtering

Juan Valacco
authored and
DishenWang2023
committed
DH-5272 add hide/exclude columns support to table -- apply to queries and golden sql pages

Juan Valacco
authored and
DishenWang2023
committed
DH-5272 fix add column visibility feature to the golden sql page -- add enable and disable capability for each column

Juan Valacco
authored and
DishenWang2023
committed
DH-5272 fix table dropwdown styles

Juan Valacco
authored and
DishenWang2023
committed
DH-5210 icon and text changes/additions

Juan Valacco
authored and
DishenWang2023
committed
[DH-5255] Fix data report (#375 )

jcjc712
authored and
DishenWang2023
committed
[DH-5279] Update SSH parameters to create a db_connection (#380 )

jcjc712
authored and
DishenWang2023
committed
DH-5264 multiple db support (#379 )

DishenWang2023
and
Juan Valacco
committed
DH-5264 fix scanning and optimistic update dbs to not filter out ones that not selected and instead not update them

Juan Valacco
authored and
DishenWang2023
committed
DH-5297 add db connection button for multiple dbs

Juan Valacco
authored and
DishenWang2023
committed
DH-5203 removed llm api key from db connection request and response (#382 )
DishenWang2023
committed
DH-5297 add loading playground when databases are loading

Juan Valacco
authored and
DishenWang2023
committed
[BUG] fixed slack installation and slack bot (#384 )
DishenWang2023
committed
DH-5314 make empty playground content grow

Juan Valacco
authored and
DishenWang2023
committed
DH-5300 added db connection removal script (#383 )
DishenWang2023
committed
DH-5307 [bugfix] - show loading screen after adding first db connection

Juan Valacco
authored and
DishenWang2023
committed
DH-5313 [bugfix] add db connection id to request body of database instructions

Juan Valacco
authored and
DishenWang2023
committed
Make update db connection id instructions optional (#386 )
DishenWang2023
committed
DH-5297 fix loading skeletons

Juan Valacco
authored and
DishenWang2023
committed
DH-5318 fixed add org with slack installation (#387 )
DishenWang2023
committed
DH-5320 catch scenario when sql results is empty

Juan Valacco
authored and
DishenWang2023
committed
DH-5323 fixed parameter variable for playground (#389 )
DishenWang2023
committed
DH-5236/update engine with newset changes (#392 )

MohammadrezaPourreza
authored and
DishenWang2023
committed
[DH-5332] Set SSH password as optional (#393 )

jcjc712
authored and
DishenWang2023
committed
DH-5333 self-serve sidebar reorganization

Juan Valacco
authored and
DishenWang2023
committed
DH Fix Postman (#400 )
DishenWang2023
committed
[DH-5335] For SSH connection take ports if they are set (#396 )

jcjc712
authored and
DishenWang2023
committed
[Engine] Lastest changes Jan 31st (#401 )

jcjc712
authored and
DishenWang2023
committed
DH-5334 new signup flow for self-serve users

Juan Valacco
authored and
DishenWang2023
committed
Release lastest dataherald changes (#404 )

jcjc712
authored and
DishenWang2023
committed
[DH-5344] Implement refresh endpoint (#406 )

jcjc712
authored and
DishenWang2023
committed
[DH-5355] Fix refreshing button to get db tables (#408 )

jcjc712
authored and
DishenWang2023
committed
Fix DB connection (#409 )

jcjc712
authored and
DishenWang2023
committed
DH-5358 fix get golden sqls (#410 )
DishenWang2023
committed
DH-5286 - self-serve flow - payments and usage (#407 )

Juan Valacco
and
DishenWang2023
committed
[DH-5363] Catch refresh service exception (#411 )

jcjc712
authored and
DishenWang2023
committed
DH-5330 fixed spending limit for credit only customers (#413 )
DishenWang2023
committed
DH-5286 - fix usage menu flickering

Juan Valacco
authored and
DishenWang2023
committed
DH-5286 - better UX when trying to access forbidden usage page

Juan Valacco
authored and
DishenWang2023
committed
Added no api test on draft logic (#414 )
DishenWang2023
committed
[DH-5372] Fix snowflake connection when a space is added at the end (#416 )

jcjc712
authored and
DishenWang2023
committed
DH-5354 make invitation message clearer

Juan Valacco
authored and
DishenWang2023
committed
DH-5374 Fix finetuning reqeuest (#417 )
DishenWang2023
committed
DH-5382 low latency parameter and misc (#418 )
DishenWang2023
committed
DH-5374 fixed empty golden sql list finetuning job (#419 )
DishenWang2023
committed
DH-5371 fix usage page -- refresh usage chart after updating spending limit -- fix usage display to be the sum of the cost and not the amont_due

Juan Valacco
authored and
DishenWang2023
committed
DH-5389 usa total cost for the chart and not the amount due

Juan Valacco
authored and
DishenWang2023
committed
DH-5286 fix sidebar flickering -- use main font naming

Juan Valacco
authored and
DishenWang2023
committed
DH-5393 add billing page with pending invoice and relocation of the payment methods

Juan Valacco
authored and
DishenWang2023
committed
DH-5375 fix overlap on error messages while adding a card

Juan Valacco
authored and
DishenWang2023
committed
DH-5393 fix billing cycle description on billing page

Juan Valacco
authored and
DishenWang2023
committed
DH-5381 add missing dot on screen message

Juan Valacco
authored and
DishenWang2023
committed
DH-5377 reduce spacing and sizes for better developer UX

Juan Valacco
authored and
DishenWang2023
committed
DH-5393 fix paywalls to update payment method

Juan Valacco
authored and
DishenWang2023
committed
DH-5396 fix payment method snackbars

Juan Valacco
authored and
DishenWang2023
committed
DH-5381 fix dots on snackbars

Juan Valacco
authored and
DishenWang2023
committed
DH-5399 fix payment plan when adding default payment (#421 )
DishenWang2023
committed
DH-5404 fix reverifying golden sql (#423 )
DishenWang2023
committed
DH-5246 add model name provider to finetuning page

Juan Valacco
authored and
DishenWang2023
committed
DH-5312 fix typo

Juan Valacco
authored and
DishenWang2023
committed
DH-5312 add slack message indications (#425 )

Juan Valacco
and
DishenWang2023
committed
DH-5312 update query when message is sent -- fix table not indicating slack message was sent

Juan Valacco
authored and
DishenWang2023
committed
DH-5418 -- DH-5400 fix credit charts to make bar line to work with 100%

Juan Valacco
authored and
DishenWang2023
committed
DH-5286 minor UI fixes

Juan Valacco
authored and
DishenWang2023
committed
Get Finetuning one line fix (#427 )
DishenWang2023
committed
DH-5425 add mobile welcome page

Juan Valacco
authored and
DishenWang2023
committed
DH-5390 added validation (#422 )
DishenWang2023
committed
DH-5409 Added POST credits endpoint (#430 )
DishenWang2023
committed
DH 5244 added db_conenction_id query param (#426 )
DishenWang2023
committed
DH-5300 fix delete script (#415 )
DishenWang2023
committed
[DH-5426] Add sqlite_file_path field for DBConnectionRequest (#428 )

jcjc712
authored and
DishenWang2023
committed
DH-5423 add organization ID to the Organization page

Juan Valacco
authored and
DishenWang2023
committed
DH-5429 updated analytics (#432 )
DishenWang2023
committed
DH-5429 fixed auth not worked (#433 )
DishenWang2023
committed
DH-5394 add playground queries to queries list

DishenWang2023
and
Juan Valacco
committed
DH-5423 remove confusing input from Organization details

Juan Valacco
authored and
DishenWang2023
committed
DH-5436 - add db connection links to docs and some guidance -- add playground hint that now they go to the queries page

Juan Valacco
authored and
DishenWang2023
committed
DH-5436 - fix broken downlod ssh key button

Juan Valacco
authored and
DishenWang2023
committed
DH-5436 - fix horizontal scrolling on add db dialog ssh form

Juan Valacco
authored and
DishenWang2023
committed
[DH-5441] Fix s3 download a file in a subfolder (#435 )

jcjc712
authored and
DishenWang2023
committed
DH-5447 added record usage analytics (#436 )
DishenWang2023
committed
DH-5442 add mariadb and clichouse db providers -- make databases the default redirection -- improve welcome ux to setup db connection

Juan Valacco
authored and
DishenWang2023
committed
DH-5424 add database connection id -- added table and column resourcers as well -- redesign of database resources sidebar

Juan Valacco
authored and
DishenWang2023
committed
DH-5460 set queries page default page size to 100

Juan Valacco
authored and
DishenWang2023
committed
Release latest engine changes (#440 )

jcjc712
authored and
DishenWang2023
committed
DATA-1956 Add run_test.py script and support files to monorepo (#385 )

dh-datateam-ainesh
authored and
DishenWang2023
committed
DH-5466 - display unknown on query source when is unknown

Juan Valacco
authored and
DishenWang2023
committed
DH-5451 switch ecs service for outbound ip (#438 )
DishenWang2023
committed
DH-5468 fix adding created_at field on user signups

Juan Valacco
authored and
DishenWang2023
committed
DH-5468 add created at field to user profile

Juan Valacco
authored and
DishenWang2023
committed
DH-5483 enforce single instruction per db connection (#450 )
DishenWang2023
committed
DH-5476 update readme for stripe (#451 )
DishenWang2023
committed
DH-5347 error handling

DishenWang2023
and
Juan Valacco
committed
DH-5437 update dataherald submodule -- error handling

Juan Valacco
authored and
DishenWang2023
committed
DH-5493 updated postman test for usage based and error handling (#454 )
DishenWang2023
committed
DH-5516 added description field to error response (#457 )
DishenWang2023
committed
DH-5518 add error box to add db form dialog

Juan Valacco
authored and
DishenWang2023
committed
DH-5482 optimized usage record script by recording usage based customers only (#459 )
DishenWang2023
committed
[DH-5517] Add CustomError for Engine (#460 )

jcjc712
authored and
DishenWang2023
committed
DH-5338 Added search function for generations and golden sql
DishenWang2023
committed
DH-5507 replace table text search for backend search on queries and golden sql tables

Juan Valacco
authored and
DishenWang2023
committed
DH-5533 add debounce to actively search queries and golden sqls without hitting enter

Juan Valacco
authored and
DishenWang2023
committed
[Engine] Lastest changes March 5th (#464 )

jcjc712
authored and
DishenWang2023
committed
Skip access token related requests and tests (#465 )
DishenWang2023
committed
DH-5529 fix snackbar action overflowing on long error messages

Juan Valacco
authored and
DishenWang2023
committed
DH-5514 enable database list revalidation and set the refresh interval to 1 minute

Juan Valacco
authored and
DishenWang2023
committed
DH-5532 changed status code for spending limit error to 400 (#471 )
DishenWang2023
committed
DH-5551 fixed error message for user deletion (#472 )
DishenWang2023
committed
Ft/dh 5465 branch ephemeral environments (#475 )

committed
remove unnecessary branch selection on manual workflow triggers

Juan Valacco
authored and
DishenWang2023
committed
fixed destroy tf (#478 )
DishenWang2023
committed
DH-5578 add stage vercel deployment -- refactor workflows -- implement general stage vercel deployment

Juan Valacco
authored and
DishenWang2023
committed
DH-5578 upgrade checkout versions

Juan Valacco
authored and
DishenWang2023
committed
DH-5578 filter version to find repo changes -- add names to stage jobs

Juan Valacco
authored and
DishenWang2023
committed
DH-5578 upgrade remaining checkout versions

Juan Valacco
authored and
DishenWang2023
committed
DH-5578 fix slackbot changes tracking

Juan Valacco
authored and
DishenWang2023
committed
DH-5578 fix - pass secrets to reusable workflows -- improve stage deployment triggering

Juan Valacco
authored and
DishenWang2023
committed
DH-5578 fix stage server ports

Juan Valacco
authored and
DishenWang2023
committed
DH-5580 first step for reusable workflows

Juan Valacco
authored and
DishenWang2023
committed
DH-5580 fix workflows on root level

Juan Valacco
authored and
DishenWang2023
committed
[DH-5594] Fix the tasks definitions and pull latest engine changes (#479 )

authored and
DishenWang2023
committed
DH-5578 add slack notification for stage deployment

Juan Valacco
authored and
DishenWang2023
committed
DH-5580 split stage deployment into reusable workflows

Juan Valacco
authored and
DishenWang2023
committed
DH-5579 add prod deploy pipeline + cleanup

Juan Valacco
authored and
DishenWang2023
committed
DH-5579 fix stage workflow

Juan Valacco
authored and
DishenWang2023
committed
DH-5365 add commit sha as tha docker image tags to keep better track of deployed version

Juan Valacco
authored and
DishenWang2023
committed
[DH-5601] Add health check for load balancers (#480 )

jcjc712
authored and
DishenWang2023
committed
DH-5613 update langchain-openai version to fix encoding (#483 )
DishenWang2023
committed
DH-5365 rename AWS resources + deploy strategies

authored and
DishenWang2023
committed
DH-5365 workflow typo

Juan Valacco
authored and
DishenWang2023
committed
[DH-5615] Fix deploy branch workflow to be executed manually (#484 )

jcjc712
authored and
DishenWang2023
committed
DH-5614 skip changes tracking for prod deployments

Juan Valacco
authored and
DishenWang2023
committed
DH-5615 fix branch deployment - setup terraform before running backend and DBs jobs

Juan Valacco
authored and
DishenWang2023
committed
DH-5615 fix terraform location on init infra job

Juan Valacco
authored and
DishenWang2023
committed
DH-5615 fix add missing trailslash

Juan Valacco
authored and
DishenWang2023
committed
DH-5615 fix auth issues to initialize branch infra

Juan Valacco
authored and
DishenWang2023
committed
DH-5560 remove search for empty search terms (#486 )
DishenWang2023
committed
[DH-5617] Remove force deployment (#485 )

jcjc712
authored and
DishenWang2023
committed
[DH-5457] Add support for SQL Server in Admin console (#476 )

jcjc712
authored and
DishenWang2023
committed
DH-5622 fix slack notification triggers + fix prod slack notification environment + add warning messages on failures

Juan Valacco
authored and
DishenWang2023
committed
[DH-5540] Update data report (#487 )

jcjc712
authored and
DishenWang2023
committed
[DH-5625] Fix background scanner process (#488 )

jcjc712
authored and
DishenWang2023
committed
[DH-5627] Change EC2 image id (#489 )

jcjc712
authored and
DishenWang2023
committed
DH-5629 fix front-end prod deployment

Juan Valacco
authored and
DishenWang2023
committed
DH-5620 fix resolve vercel env depending on target env

Juan Valacco
authored and
DishenWang2023
committed
DH-5586 Added Liquibase database migration tools and sample db dump (#482 )

DishenWang2023
and
Juan Valacco
committed
DH-5581 modularized terraform resources (#490 )
DishenWang2023
committed
DH-5581 fix destroy tf (#491 )
DishenWang2023
committed
DH-5581 fix pinecone env var (#494 )
DishenWang2023
committed
DH-5581 fixed branch deploy subnet (#495 )
DishenWang2023
committed
DH-5581 fix typo (#499 )
DishenWang2023
committed
DH-5524 Added Token Auth disabled mode (#496 )
DishenWang2023
committed
DH-5524 fixed login authentication (#502 )
DishenWang2023
committed
DH-5671 added copy org resource script (#503 )
DishenWang2023
committed
DH-5677 remove dh_internal from response model example (#504 )
DishenWang2023
committed
DH-5683 sort get orgs name (#506 )
DishenWang2023
committed
DH-5646 Add playground stream (#493 )

Juan Valacco
and
DishenWang2023
committed
DH-5689 fix slack notif of deploy env

Juan Valacco
authored and
DishenWang2023
committed
DH-5690 fix playground no db connection flow

Juan Valacco
authored and
DishenWang2023
committed
DH-5690 fix env deployments on cancelled jobs

Juan Valacco
authored and
DishenWang2023
committed
DH-5693 fix playground loading flickering

Juan Valacco
authored and
DishenWang2023
committed
DH-5690 fix no db connection playground flow

Juan Valacco
authored and
DishenWang2023
committed
DH-5611 - fix env deployment workflow to safely use YAML preserved ! symbol

Juan Valacco
authored and
DishenWang2023
committed
DH-5696 add discord channel button + billing support

Juan Valacco
authored and
DishenWang2023
committed
DH-5611 fix slackbot deployment trigger

Juan Valacco
authored and
DishenWang2023
committed
DH-5674 add infra for soc2 (#510 )
DishenWang2023
committed
DH-5688 fix engine formatting for streaming responses (#508 )

committed
DH-5688 add delay to streaming

Juan Valacco
authored and
DishenWang2023
committed
Dh 5708 non customer branch (#515 )

Juan Valacco
authored and
DishenWang2023
committed
DH-5708 add missing slack variables tro branch destruction

Juan Valacco
authored and
DishenWang2023
committed
DH-5709 set default start DB for branch deployment workflow

Juan Valacco
authored and
DishenWang2023
committed
DH-5709 update terraform serverless pinecone provider to official one

Juan Valacco
authored and
DishenWang2023
committed
DH-5709 fix missing pinecone provider migration

Juan Valacco
authored and
DishenWang2023
committed
DH-5696 update contact billing support and community links

Juan Valacco
authored and
DishenWang2023
committed
DH-5715 preven concurrent billable endpoint to exceed spending limit (#518 )
DishenWang2023
committed
Revert "DH-5715 preven concurrent billable endpoint to exceed spending limit …" (#519 )
DishenWang2023
committed
[DH-5723] Add redshift support (#522 )

jcjc712
authored and
DishenWang2023
committed
[DH-5730] Fix Redshift dialect (#524 )

jcjc712
authored and
DishenWang2023
committed
DH-5673 singup sample db (#521 )

DishenWang2023
and
Juan Valacco
committed
DH-5738 fixing the malformed sql queries

Juan Valacco
authored and
DishenWang2023
committed
DH-5747n fix request body param (#525 )
DishenWang2023
committed
DH-5738 fixing the few-shot samples format

Juan Valacco
authored and
DishenWang2023
committed
DH-5751 remove source column from Golden SQL table

Juan Valacco
authored and
DishenWang2023
committed
DH-5767 fixed last schema time (#533)
DishenWang2023
committed
DH-5670 Multiple Schema support (#531)

committed
DH-5670 uppercase sort headers

Juan Valacco
authored and
DishenWang2023
committed
DH-5772 change s3 bucket name to env var (#535)
DishenWang2023
committed
add s3 images to the repository

Juan Valacco
authored and
DishenWang2023
committed
restore openai key feature

Juan Valacco
authored and
DishenWang2023
committed
DH-5774 added organization dump file migration script (#537)
DishenWang2023
committed
DH-5773 added llm key back to enterprise (#536)
DishenWang2023
committed
add docker and local docker compose to admin console frontend (#538)

Juan Valacco
authored and
DishenWang2023
committed
DH-5770 updated cleanup, added front-end dockerfile and org migration scripts
DishenWang2023
committed