feat: Über Migration (and Boxo rename)#220

Merged

Jorropo merged 4206 commits intomainfrom uber-migration

Mar 27, 2023

+63,881-1,841

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 22, 2021

Commits on Oct 28, 2021

feat: add context to interface (#18 )
guseggert
authored

Commits on Oct 29, 2021

feat: plumb through context changes (#28 )
guseggert
authored

Commits on Nov 1, 2021

Add a barebones readme to the car CLI (#262 )
willscott
authored

Commits on Nov 9, 2021

support extraction of unixfs content stored in car files (#263 )
willscott
authored

Commits on Nov 11, 2021

Commits on Nov 12, 2021

Commits on Nov 15, 2021

feat: plumb through datastore context changes

guseggert
authored and
aschmahmann
committed

Commits on Nov 16, 2021

support threshold based automatic sharding and unsharding of directories (#88 )
schomatis
authored

Commits on Nov 17, 2021

Commits on Nov 18, 2021

Seek to start before index generation in ReadOnly blockstore
masih
committed

Commits on Nov 22, 2021

fix: remove context from HashOnRead
guseggert
committed
feat: plumb through context changes

guseggert
authored and
aschmahmann
committed

Commits on Nov 29, 2021

feat: plumb through datastore contexts
aschmahmann
committed

Commits on Nov 30, 2021

Traversal-based car creation (#269 )
willscott
authored

Commits on Dec 9, 2021

feat: per-cid locking

Stebalien
authored and
aschmahmann
committed

Commits on Dec 10, 2021

Commits on Dec 11, 2021

Update v2 to context datastores (#275 )
arajasek
authored

Commits on Jan 6, 2022

make specification of root cid in get-dag command optional (#281 )
willscott
authored

Commits on Jan 13, 2022

add car root command (#283 )
willscott
authored

Commits on Jan 20, 2022

add car detach-index list to list detached index contents (#287 )
willscott
authored

Commits on Jan 21, 2022

Commits on Feb 9, 2022

cmd/car: use a better install command in the README
Jorropo
authored

Commits on Feb 10, 2022

Commits on Feb 15, 2022

Allow extracton of a raw unixfs file (#284 )
willscott
authored

Commits on Feb 25, 2022

Resolver: convert to interface.
hsanjuan
committed

Commits on Mar 3, 2022

fix(test): rootless fixture should have no roots, not null roots

rvagg
authored and
mvdan
committed

Commits on Mar 17, 2022

Use ipld.ErrNotFound for NotFound errors

hsanjuan
authored and
Jorropo
committed
s/log/logger

hsanjuan
authored and
Jorropo
committed
Use ipld.ErrNotFound instead of ErrNotFound

hsanjuan
authored and
Jorropo
committed
s/log/logger

hsanjuan
authored and
Jorropo
committed
Improve NotFound error description

hsanjuan
authored and
Jorropo
committed
Improve ErrNotFound

hsanjuan
authored and
Jorropo
committed
Use ipld.ErrNotFound

hsanjuan
authored and
Jorropo
committed
refactor: follow the happy left practice in Filestore.DeleteBlock
Jorropo
committed
Update tests to use ipld.IsNotFound to check for notfound errors

hsanjuan
authored and
Jorropo
committed

Commits on Mar 18, 2022

sync: update CI config files (#15 )
web3-bot
authored

Commits on Mar 23, 2022

Resolver: unexport BasicResover
hsanjuan
committed

Commits on Mar 24, 2022

Commits on Mar 25, 2022

Commits on Apr 2, 2022

fix: use IPLD.ErrNotFound instead of string comparison in tests
Jorropo
committed

Commits on Apr 6, 2022

Commits on Apr 8, 2022

feat: add tracing (#30 )
guseggert
authored

Commits on Apr 21, 2022

refactor(block): CIDv1 and BlockPutSettings CidPrefix (#80 )
schomatis
authored

Commits on Apr 25, 2022

bump to newer blockstore err not found (#301 )
willscott
authored

Commits on Apr 26, 2022

fix: error handling while enumerating pins

lidel
authored and
Jorropo
committed

Commits on Apr 27, 2022

fix: CIDv1 error with go-libp2p 0.19 (#32 )
lidel
authored

Commits on May 5, 2022

Commits on May 6, 2022

feat: fast-path for PutMany, falling back to Put for single block call (#97 )
MichaelMure
authored

Commits on May 12, 2022

Commits on May 31, 2022

PrototypeChooser support (#305 )
willscott
authored

Commits on Jun 16, 2022

Make switchToSharding more efficient

hsanjuan
authored and
aschmahmann
committed

Commits on Jun 30, 2022

Add API to regenerate index from CARv1 or CARv2
masih
committed

Commits on Jul 6, 2022

fix: don't OOM if the header size is too big

Jorropo
authored and
masih
committed
fix: do bound check while checking for CIDv0

Jorropo
authored and
masih
committed
test: add fuzzing of NewCarReader

Jorropo
authored and
masih
committed
fix: v2 don't OOM if the header size is too big

Jorropo
authored and
masih
committed
test: v2 add fuzzing to BlockReader

Jorropo
authored and
masih
committed
fix: v2 don't accept overflowing offsets while reading v2 headers

Jorropo
authored and
masih
committed
test: v2 add fuzzing to Reader

Jorropo
authored and
masih
committed
fix: v2 don't allocate indexes too big

Jorropo
authored and
masih
committed
fix: v2 don't divide by zero in width indexes

Jorropo
authored and
masih
committed
test: v2 add fuzzing of the index

Jorropo
authored and
masih
committed
ci: add fuzzing on CI

Jorropo
authored and
masih
committed
feat: Refactor indexes to put storage considerations on consumers

Jorropo
authored and
masih
committed
fix index comparisons

rvagg
authored and
masih
committed
fix: revert to internalio.NewOffsetReadSeeker in Reader#IndexReader

rvagg
authored and
masih
committed
fix: staticcheck catches

rvagg
authored and
masih
committed
fix: don't use multiple-go-modules for fuzzing

rvagg
authored and
masih
committed
fix: use CidFromReader() which has overread and OOM protection

rvagg
authored and
masih
committed
feat: MaxAllowedSectionSize default to 32M

rvagg
authored and
masih
committed
feat: MaxAllowed{Header,Section}Size option

rvagg
authored and
masih
committed
fix: explicitly disable serialization of insertionindex

rvagg
authored and
masih
committed
fix: tighter constraint of singleWidthIndex width, add index recommentation docs

rvagg
authored and
masih
committed
Fix testutil assertion logic and update index generation tests
masih
committed
Use a fix code as the multihash code for CarIndexSorted
masih
committed
Remove support for ForEach enumeration from car-index-sorted
masih
committed
feat: add Reader#Inspect() function to check basic validity of a CAR and return stats

rvagg
authored and
masih
committed
feat: add block hash validation to Inspect()

rvagg
authored and
masih
committed
test: add fuzzing for reader#Inspect

Jorropo
authored and
masih
committed
Use streaming APIs to verify the hash of blocks in CAR Inspect
masih
committed
Use consistent CID mismatch error in Inspect and BlockReader.Next
masih
committed
Benchmark Reader.Inspect with and without hash validation
masih
committed
Drop repeated package name from CarStats
masih
committed
Return error when section length is invalid varint
masih
committed
Fix fuzz CI job
masih
committed
Revert changes to index.Index while keeping most of security fixes
masih
committed
Revert changes to insertionindex
masih
committed
ci: remove the reverted FuzzIndex fuzzer

Jorropo
authored and
masih
committed
Empty identity CID should be indexed when options are set
masih
committed

Commits on Jul 7, 2022

Upgrade to the latest go-car/v2
masih
committed

Commits on Jul 13, 2022

Commits on Jul 14, 2022

Commits on Jul 15, 2022

feat: add car inspect command to cmd pkg (#320 )
rvagg
authored

Commits on Jul 28, 2022

refactor: rewrite getBlocks batch loop to be clearer
Jorropo
committed

Commits on Aug 1, 2022

blockstore: allow to pass a file to write in (#323 )
MichaelMure
authored
OpenReadWriteFile: add test

MichaelMure
authored and
masih
committed

Commits on Aug 5, 2022

docs: Add proper documenation to the interface.
MichaelMure
authored

Commits on Aug 12, 2022

feat: add blake3 as a good hash

laudiacay
authored and
Jorropo
committed

Commits on Aug 19, 2022

use peer.IDFromBytes instead of peer.IDFromString (#38 )
marten-seemann
authored

Commits on Aug 25, 2022

fix!: keep deserialised state stable until explicit mutation
rvagg
committed
run gofmt -s

web3-bot
authored and
rvagg
committed
fix: remove use of ioutil
rvagg
committed
bump go.mod to Go 1.18 and run go fix

web3-bot
authored and
rvagg
committed
bump go.mod to Go 1.18 and run go fix

web3-bot
authored and
rvagg
committed
run gofmt -s

web3-bot
authored and
rvagg
committed
fix: remove use of ioutil
rvagg
committed
sync: update CI config files (#87 )
web3-bot
authored

Commits on Aug 26, 2022

sync: update CI config files (#125 )
web3-bot
authored

Commits on Aug 27, 2022

update go-libp2p to v0.22.0, release v0.2.0 (#39 )
marten-seemann
authored

Commits on Aug 29, 2022

Commits on Sep 9, 2022

feat: Has() and Get() will respect StoreIdentityCIDs option
rvagg
committed

Commits on Sep 12, 2022

chore: require V2 signatures
lidel
committed

Commits on Sep 13, 2022

chore: update go-libp2p to v0.22.0
nisainan
committed

Commits on Sep 19, 2022

Merge pull request ipfs/go-ipfs-routing#35 from nisainan/master
willscott
authored

Commits on Sep 20, 2022

Commits on Sep 30, 2022

feat: check that the CidBuilder hasher is usable
rvagg
committed

Commits on Oct 4, 2022

Commits on Oct 12, 2022

Fix: panic when childer is nil (#127 )
ajnavarro
authored

Commits on Oct 20, 2022

add a SkipNext method on block reader (#338 )
willscott
authored

Commits on Oct 21, 2022

Commits on Nov 18, 2022

Add a debugging form for car files. (#341 )
willscott
authored

Commits on Nov 23, 2022

Commits on Dec 6, 2022

stop using the deprecated io/ioutil package
web3-bot
committed

Commits on Dec 9, 2022

chore: update go-lib2p, avoid depending on go-libp2p-core, bump go.mod version

marten-seemann
authored and
Jorropo
committed
Merge commit "fix: queue: switch from using a time based counter to a monotonic one "
Jorropo
committed
Merge branch 'master'
Jorropo
committed
fix: multihash keying in the tests
Jorropo
committed
Merge pull request ipfs/go-ipfs-provider#36 from ipfs/web3-bot/sync
Jorropo
authored
chore: update go-libp2p

marten-seemann
authored and
Jorropo
committed
chore: update go-libp2p to v0.23.4

marten-seemann
authored and
Jorropo
committed
fix: make queue 64bits on 32bits platforms too
Jorropo
committed
stop using the deprecated io/ioutil package

web3-bot
authored and
Jorropo
committed
chore: update go-libp2p to v0.23.4, update go.mod version to 1.18

marten-seemann
authored and
Jorropo
committed

Commits on Dec 12, 2022

feat: add UseCumulativeSize UnixfsLs option (#95 )
hacdias
authored

Commits on Jan 12, 2023

Commits on Jan 16, 2023

feat(cmd): add index create subcommand to create an external carv2 index
aschmahmann
committed

Commits on Jan 19, 2023

Update install instructions in README.md

gammazero
authored and
rvagg
committed

Commits on Jan 23, 2023

cleanup readme a bit to make the cli more discoverable (#353 )
willscott
authored

Commits on Jan 24, 2023

Commits on Jan 27, 2023

Commits on Jan 28, 2023

Merge pull request ipld/go-car#357 from leszko/allow-using-walk-func
willscott
authored

Commits on Jan 30, 2023

Commits on Feb 1, 2023

Merge pull request ipld/go-car#350 from ipld/feat/cmd-create-external-index
willscott
authored

Commits on Feb 8, 2023

Commits on Feb 10, 2023

Commits on Feb 14, 2023

stop using the deprecated io/ioutil package

web3-bot
authored and
rvagg
committed
fix: switch to crypto/rand.Read
rvagg
committed

Commits on Feb 20, 2023

blockstore: fast path for AllKeysChan using the index

MichaelMure
authored and
rvagg
committed

Commits on Feb 22, 2023

feat!: add and connect missing context, remove RemovePinWithMode (#23 )
MichaelMure
authored

Commits on Feb 23, 2023

feat: expose ErrInvalidPath and implement .Is function (#66 )
hacdias
authored

Commits on Feb 27, 2023

docs(pinning): eliminate copy-n-paste typo (#28 )
smoyer64
authored

Commits on Mar 6, 2023

feat: add WithTrustedCar() reader option (#381 )
hsanjuan
authored

Commits on Mar 7, 2023

Commits on Mar 8, 2023

Commits on Mar 9, 2023

docs: improved DNSLink lookup error

lidel
authored and
hacdias
committed

Commits on Mar 14, 2023

fix: let extract skip missing unixfs shard links
rvagg
committed

Commits on Mar 16, 2023

ReadWrite: faster Has() by using the in-memory index instead of reading on disk

MichaelMure
authored and
rvagg
committed

Commits on Mar 20, 2023

Commits on Mar 22, 2023

blockstore: give a direct access to the index for read operations

MichaelMure
authored and
rvagg
committed

Commits on Mar 27, 2023

feat: Über Migration (and Boxo rename)
Jorropo
committed