This is a fully decentralized blockchain project that implements some of the major features of popular cryptocurrency project like Bitcoin and ethereum using go programming language. This an experimental project for learning purposes and it contains a detailed overview of how blockchain works, most importantly how this project works. This project was inspired by Go Ethereum and bitcoin. This projects is built on existing research and experimentation but offer better networking implementation with the use of automatic peer discovery with the help of lip2p library collection and CLIUI for each Host/Peers to see how peers interact with each other in realtime
- Blockchain
- Nodes
- Consensus, Blocks & Proof Of Work (POW)
- Wallet
- Transactions
- Uspent Transaction Output (UTXO)
- Merkle Tree
- Networking (P2P/Distributed System)
| Folder | Contents |
|---|---|
./p2p |
Scripts for the crypto project Network Layer |
./Binaries |
An on-demand Folder for executable E.G Wallet |
./cmd |
CLI Scripts for interacting with the blockhain |
./wallet |
Wallet Source code. |
./examples |
Code samples for API wrappers written in Go, Python, Rust and JS E.T.C |
Blockchain can be defined as a database that stores blocks, with every next block being linked to the previous one in form of a linked list and a cryptographically secure way so that it’s not possible to change anything in previous blocks, it is a decentralized distributed system of Nodes/Peers that works in a coordinated way. What are Distributed systems? this is a computing paradigm whereby two or more nodes work with each other in a coordinated fashion to achieve a common outcome and it's modeled in such a way that end-users see it as a single logical platform. Distributed systems are interestingly complex due to the ability of nodes to coordinate themselves properly, consistency, E.T.C.
Nodes can be defined as any kind of device(mostly computers), phones, laptops, large data centers that uses graphics processing unit(GPU) , Tensor Processing Unit (TPU) E.T.C for expensive and overhead computations. Nodes form the basic infrastructure of a blockchain network, without a node there is no network. All nodes on a blockchain are connected to each other and they constantly exchange the latest blockchain data with each other so that all nodes stay up to date. The main purpose of nodes includes but not limited to: storage of blockchain data, verifying of new transactions and blocks, helping of new and existing nodes stay upto date E.t.c.
This blockchain comprises of three types of nodes which includes:
This is the most important node in the blockchain network, they keep the network running, they foster the minting of new coins, they verify transactions , verifies and mine new blocks.
This type of nodes fosters the verifications of new transactions, manage memory pool (unconfirmed transactions) for miners and also verifies new blocks.
This type of nodes are part of the network to keep the network running, they mostly verify new blocks on the network
The-crypto-project only supports 1 fullnode and 1 mining node with infinite number of ordinary node due to underlining issues with the memorypool and the mining implementation as explained here
Consensus mechanism means to reach agreements among network nodes or systems. It fosters consistency of information accross multiple Nodes. Most financial institution today are centralized with lot's of restrictions and regulations, blockchian helps remove that barrier and consensus mechanism is an essential part of the blockchain network because it allows every nodes in the network to maintain an identical copy of the database. Otherwise, we might end up with conflicting information, undermining the entire purpose of the blockchain network. Bitcoin was the first cryptocurrency to solve the problem of distributed consensus in a trustless network by using the idea behind Hashcash. Hashcash is a proof-of-work algorithm, which has been used as a denial-of-service (Dos)counter measure technique in a number of systems. Proof of work fosters minting of new digital currency in blockchain network by allowing Nodes to perfrorm expensive computer calculation, also called mining, that needs to be performed in order to create a new group of trustless transactions that forms a block on a distributed ledger called blockchain. The key purpose of this is to prevent double spending, distributed denial-of-service attack (DDoS) E.T.C. There are different kinds of consensus mechanism algorithms which work on different principles E.G Proof of Capacity (POC) and proof of stake (POS) but this project implements the Proof of work algorithm used in bitcoin & litecoin
We basically check for two things.
-
We Check if the previous block referenced by the block exists and is valid.
-
We Check that the proof of work done on the block is valid.
The wallet system, comparable to a bank account, contains a pair of public and private cryptographic keys. The keys can be used to track ownership, receive or spend cryptocurrencies. A public key allows for other wallets to make payments to the wallet's address, whereas a private key enables the spending of cryptocurrency from that address.
The wallet system is independent of the blockchain network and it is built ontop of the demon Command line(the network default CLI) and also there is a dedicated executable file in the binaries folder coupled with basic commands for performing different actions like generating new wallet, listing existing wallets.
NB: In order to perform any action that requires the address, it is important to use the cli command for generating wallets because the node or peer doesn't have access to the wallet generated outside of itself and there are no ways to import a wallet to a node just yet.
Or Re-Build Wallet by navigating to this folder and proceed to execute the below command to build the wallet
go build
Generate new wallet
./wallet new
Print all local wallet
./wallet print
Print wallet by Address
./wallet print --address ADDRESS
A transaction is a transfer of value between wallets that gets included in the block chain as defined by bitcoin.org. It comprises of the transaction Inputs and outputs, the transaction inputs comprises of an array of spent coins gotten from the outputs while transaction outputs comprises of unspent coins. This transactions are signed with a secret called private key that can be found in the user wallet to proof that a user is indeed the owner of the coins, this transactions is initialized and sent to the network which in turn under-goes a series of verification by the network nodes to confirm the validity of the transaction using the user's public key.
This is also know as the transaction pool, this is the waiting area for unconfirmed transactions. When a transaction is carried out by a user, it is sent out to all the avialaible full nodes in the network, this full nodes verifies the transaction before adding it to their memory pool while waiting for mining nodes to pick it up and includes it in the next block.
What is the Bitcoin Mempool? A Beginner's Explanation (2020 Updated)
This concept became really popular due to the bitcoin blockhain and this can be defined as an output of a blockchain transaction that has not been spent
They are available to be used in new transactions (as long as you can unlock them with your private key), which makes them useful. UTXOs is used as inputs when a user tries to send X amount of coin to Y person given that the amount of UTXOs that the user can unlock is enough to be used as an input. Calculating a wallet address balance can be gotten by accumulating all the unspent transaction outputs that are locked to the particular address
Blockchain data are quite verbose, it can range from hundrends to billions of data and computing user wallet balance from a blockchian of that size is computationally expensive in which UTXOs came in as a rescue to reduce overhead. UTXOs ain't all that clever but it's a progress, and every idea has it's tradeoff's. Ethereum introduced it's own way to compute user balance
UTXOs are stored on BadgerDB and specific commands were provided to handle this but Note, UTXOS are created from the blockchain starting from the genesis block and it is computed everytime a new transaction is carried out and when a new block is added as opposed everytime a user checks his/her balance.
A Merkle tree can be simply defined as a binary hash tree data structure , composed of a set of nodes with a large number of leaf nodes at the bottom of the tree containing the underlying data, a set of intermediate nodes where each node is the hash of its two children, and finally a single root node, also formed from the hash of its two children, representing the "top" of the tree called the merkle root, which enables the quick verification of blockchain data, as well as quick movement of large amounts of data from one computer node to the other on the blockchain network. The transactions are executed on a merkle tree algorithm to generate a single hash which is a string of numbers and letters that can be used to verify that a given set of data is the same as the original set of transactions.
The Blockchain protocol operates on top of the Internet, on a P2P network of computers that run the protocol and hold an identical copy of the ledger of transactions , enabling P2P value transactions without a middleman through consensus mechanism. In computing, p2p is a network of peers that enables the storage and sharing of files with equal power( might differs in terms of computation) and functionality. They can act as both a client and a server, exchanging information in realtime and when a node acts as a client, they download files from other network nodes. But when they are working as a server, they are the source from which other nodes can download files. P2P networks don’t have a single point of failure and enables a system to continue operating properly in the event of the failure know as fault tolerance. The P2P network is an essential part of the blockchain network because it allows the distribution of blockchain data across mulitple node/peer, it prevents the Denial-of-Service (DoS) attacks that plague numerous systems, and also renders them resistant to censorship by central authorities. The major limitation of P2p is the ability to maintain consistent in data across all peers (subjective) and also proof of work is way too computationally expensive for a less powerful computer and this will only get worse as the Blockchain gets bigger with an increase in difficulty which means nodes who has less computational power to participate will eventually leave, but on the bright side, P2P makes decentralization possible and provides overall security for the blockchain.
the-crypto-project achieved 100% decentralization via the use of libp2p-go networking libraries used by popular project like Ipfs, filecoin and most recently Ethereum 2.0.
This is the official command line for the crypto project, this commandline allows developers to interact with the blockchain network
Navigate to this folder and run the below command to build the cli
go build
Generate new wallet
./demon wallet new
List Addresses
./demon wallet listaddress
Get Balance
./demon wallet balance --address <ADDRESS>
Print blockchain
./demon print
Compute UTXOs
./demon computeutxos
Send
./demon send --sendfrom <ADDRESS> --sendto <ADDRESS> --amount <AMOUNT>
Start RPC server
Default port is 5000
./demon --rpc --rpcport 4000
Start Node
As a Miner
./demon startnode --port <PORT> --address <MINER_ADDRESS> --miner --instanceid <INSTANCE_ID>
As a fullnode
./demon startnode --port <PORT> --fullnode --instanceid <INSTANCE_ID>
The address, fullnode, miner and port Flags are optional if this flags already exist in the .env file
WALLET_ADDRESS_CHECKSUM = 4
WALLET_ADDRESS_CHECKSUM = 4
MINER_ADDRESS = <YOUR_WALLET_ADDRESS>
MINER = true
NB: Running multiple instance of the blockchain requires you to initialize a new blockchain with a --instanceid flag and also use this flag subsequently when trying to access information related to that instance.
This command creates the genesis block and initialize the blockchain. Instanceid allows you to run multiple instance of the blockchain. This must be a string E.g 5000
./demon init --address <YOUR_WALLET_ADDERESS> --instanceid <USE_ANYTHING>
As a Miner
./demon startnode --port <PORT> --address <MINER_ADDRESS> --miner --instanceid <INSTANCE_ID> --rpc --rpcport <PORT
As a fullnode
./demon startnode --port <PORT> --fullnode --instanceid <INSTANCE_ID> --rpc --rpcport <PORT>
As an Ordinary Node
./demon startnode --instanceid <INSTANCE_ID> --rpc --rpcport <PORT>
Create Wallet
Example
curl -X POST -H "Content-Type: application/json" -d '{"id": 1, "method": "API.CreateWallet", "params": []}' http://localhost:5000/_jsonrpc
Get Balance
Example
curl -X POST -H "Content-Type: application/json" -d '{"id": 1, "method": "API.GetBalance", "params": [{"Address":"1EWXfMkVj3dAytVuUEHUdoAKdEfAH99rxa"}]}' http://localhost:5000/_jsonrpc
Get Blockchain
Example
curl -X POST -H "Content-Type: application/json" -d '{"id": 1,"method": "API.GetBlockchain", "params": []}' http://localhost:5000/_jsonrpc
Get Block by Height
Example
curl -X POST -H "Content-Type: application/json" -d '{"id": 1,"method": "API.GetBlockByHeight", "params": ["Height":1]}' http://localhost:5000/_jsonrpc
Send
Example
curl -X POST -H "Content-Type: application/json" -d '{"id": 1 , "method": "API.Send", "params": [{"sendFrom":"1D214Jcep7x7zPphLGsLdS1hHaxnwTatCW","sendTo": "15ViKshPBH6SzKun1UwmHpbAKD2mKZNtBU", "amount":0.50, "mine": true}]}' http://localhost:5000/_jsonrpc
Usage:
demon [flags]
demon [command]
Available Commands:
computeutxos Re-build and Compute Unspent transaction outputs
help Help about any command
init Initialize the blockchain and create the genesis block
print Print the blocks in the blockchain
send Send x amount of token to address from local wallet address
startnode start a node
wallet Manage wallets
Flags:
--address string Wallet address
-h, --help help for demon
--instanceid string Node instance
--rpc Enable the HTTP-RPC server
--rpcaddr string HTTP-RPC server listening interface (default:localhost)
--rpcport string HTTP-RPC server listening port (default: 5000)
Use "demon [command] --help" for more information about
a command.
This blockchain project doesn't handle fork and it also lacks a proper memory pool implementation for nodes which in turns impact the ability to have more than one mining and fullnode in the system.
- Improve Memorypool and Mining implementation
- Basic Virtual Machine (Maybe)
- Test Coverage
- Improve Error Handling
The below resources and courses made this possible.
- Blockchain Basic, A Non-technical guide
- MIT 6.824 Distributed Systems (Spring 2020)
- Advanced Blockchain Concepts for Beginners
- Tensor go programming
- MerkleTree
- BadgerDB
- Wallet
- How Bitcoin Works under the Hood
- What is the difference between decentralized and distributed systems?
- Ethereum Geth
- Original Bitcoin Client
- Libp2p Overview
- bitcoin memory pool
- Merkle Tree by investopedia
- P2P Explained
- Big data and business intelligence