About the project
Providing **dashboard** & **portfolio** tools around the {'NFT ecosystem'}.
# -------------------------------------------------------------------------------
Developed a fail-proof $ETL that extracts data from both on-chain [Ethereum]
and off-chain [Twitter, Opensea, X2Y2, LooksRare etc.] sources.
# -------------------------------------------------------------------------------
- Used $Redis as a checkpoint caching mechanism.
- Used $RabbitMQ for producer-consumer pattern.
# -------------------------------------------------------------------------------
It also determined storage methods [$IPFS, $Arweave etc.] of NFT collections.
See the demo
https://youtu.be/1CkGmMU-nL4
Details of our work
- Developed NFTBull ETL Engine
- Capable of indexing on-chain and off-chain data.
- Used RabbitMQ for producer-consumer pattern.
- Utilized Redis for checkpoint caching mechanism to ensure data integrity.
- PostgreSQL
- Used for data warehousing
- dbt
- Developed complex SQL models that curates active listings using both on-chain and off-chain NFT marketplace data.