Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

event processor #5

Merged
merged 2 commits into from
Sep 19, 2024
Merged

event processor #5

merged 2 commits into from
Sep 19, 2024

Conversation

bogdan-rosianu
Copy link
Collaborator

Type

  • Bug
  • Feature
  • Refactoring
  • Performance improvement

Problem setting

  • In order to simplify the processing, we can have a component similar to transaction-processor

Proposed Changes

  • added event processor class

@bogdan-rosianu bogdan-rosianu self-assigned this Sep 19, 2024
@bogdan-rosianu bogdan-rosianu changed the base branch from main to development September 19, 2024 11:42
@bogdan-rosianu bogdan-rosianu merged commit 386c9fb into development Sep 19, 2024
1 check failed
bogdan-rosianu added a commit that referenced this pull request Sep 20, 2024
* added controller,service and module for events-webhook route

* Work in progress

* Work in progress

* Computed liquidity and data formated for addLiquidity/removeLiquidity events

* Add events parsing and liquidity computation

* Add prices fetch

* Start even fetching script

* Finish script

* Added data service to fetch token price by day and cache it

* Improvements

* Fetch events script update

* Fix minor bugs

* Working on dune sender service

* created class manager for and automated creating tables and sending data to dune

* Add redis cache for records

* Change records sending to dune logic

* Add OriginLogger

* Bug fixes

* WIP

* .

* WIP

* Parse events fields from hex to base64

* Add default price for tokens if not available on data-api

* Project clean

* Bug fix

* Create Dune Mock service WIP

* Added dune mock app API

* Added script to generate area chart for each pair present in mongodb

* store any type of csv in mongo and code improvements

* Linter update

* dune-mock renamed to dune-simulator, update linter, code improvements

* update package.json for dune-simulator renaming

* replicate dune insert data into table on dune simulator

* linter fixes

* replicate dune create table on dune simulator

* replicate dune create table on dune simulator

* dune api url from env accepts either dune url or dune simulator url

* route path for create table fix

* Change Locker.lock with RedLockService for csv-records class manager

* Created endpoint that returns a chart image for a specified pair (not working for charts with many points)

* chart png can be created regardless the amount of points, added new endpoint that returns html document with the chart

* Added service parser for HATOM borrowing events + bug fixes

* denominate usdt

* test

* test

* add retry interval for redlock

* synchronization bug fix on hatom events

* parse events into a table

* test

* cron every 1 minute

* test

* store csv files as dynamic collections

* added xaxis and yaxis as url param to generate custom charts

* Rename hatomEventsService to hatomBorrowEventsService

* added util joinCsvAttributes function

* convert all headers and csvFileNames to snakeCase in csvRecords class manager

* decode event identifier and compare to readable string borrow_event

* code improvements

* event processor (#5)

* event processor

* move event processor to libs

* Parse Hatom Market Events (#3)

* add parser service for enter_market_event and price fetch for hatom tokens

* lint fix

* check topic length for each event before decoding and encapsulate magic string

* check events topics length update

* added total value in usd and egld at each enter market event timestamp

* typo fix

* create new app transactions-processor

* Fix mongodb set timestamp bug

* replace app api with events-processor

* create a new instance of event processor for each type of event

* identantion and linter fixes

* readme documentation

* update README

* readme updates

* extended readme

* change docs header

* fix typo

---------

Co-authored-by: Nicolae Mogage <mogagenicolae@yahoo.com>
Co-authored-by: bogdan-rosianu <bogdan.rosianu@yahoo.com>

---------

Co-authored-by: GuticaStefan <stefan.gutica@gmail.com>
Co-authored-by: Nicolae Mogage <mogagenicolae@yahoo.com>
Co-authored-by: GuticaStefan <123564494+GuticaStefan@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant