forked from beancount/beancount
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES
4384 lines (2861 loc) · 165 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
========================
beancount: CHANGES
========================
Note: This file contains a list changes in the 'v2' branch.
The master branch will rely on the Git repository history.
2024-06-16
- Created branch 'v3' and released 3.0.0
Based on our recent discussion around Beancount branches being confusing, I did the following to branches:
- v2: remains the same (no change); but v2 is now even less subject to freeze exceptions than before, because v3 is now officially born and PyPI releases will be made for it. The default reply to patches to v2 will be "move that to v3."
- cpp: I turned the previous master branch's state with all C++ and Bazel build into a new 'cpp' branch.
All work on the C++ rewrite -- if it is to continue -- will live on that branch.
If things do move to Rust, I will probably salvage bits and pieces of that manually into a 'rust' branch.
In particular, the schema defined in the proto files is something I'd like to carry forward (nicely
documented and distinguishes between the pre and post interpolation data structures explicitly),
and perhaps the new reFlex parser will be useful at some point.
- v3: a new branch, to contain the state of the master branch MINUS the C++ bits.
As stated above, the C++ code remains only on branch 'cpp'.
This is now the official release branch and PyPI releases will be made of it.
- master: this branch is now where new work on v3 might live.
I'm not sure we really need it or what it should mean, but it should track v3 for now.
I've reviewed missing PyPI releases and made sure we have these:
https://pypi.org/project/beancount/
https://pypi.org/project/beangulp/
https://pypi.org/project/beanquery/
https://pypi.org/project/beanprice/
https://pypi.org/project/beangrow/
https://pypi.org/project/beancount2ledger/
The inclusion of v3 releases for PyPI and new PyPI releases for subprojects should normalize the versioning situation in Beancount. Note that packaging and following other people's conventions are not my forte (and I don't use PyPI for my own projects I just use source), if you have any suggestions or something's missing please reply to this thread.
Thanks for your patience,
2022-02-15
- Released 2.3.5 with only a few minor bugfixes. Mainly released for 3.10.
2021-03-20
- Fixed #639: Released 2.3.4.
2021-01-09
- Fixed bug in booking that assumed number is set on cost. I did this while
running booking manually on entries freshly created on an importer (never ahd
done that before, will be customary in v3).
2021-01-08
- Fixed recently introduced bug with the export script that reordered the
columns.
- Fixed bug with printer leaving trailing whitespace. Was annoying.
2020-12-20
- Merged half of branch pr128_seltzered_beanpriceupdate on this side of
Beancount. The other side will be patched to
http://github.com/beancount/beanprice. This adds some trimming functions to
beancount.ops.lifetimes.
2020-12-14
- Fixed #588: Catch more narrow exceptions from plugins and render full stack
when caught.
2020-11-25
- Fixed #584 - a bug which was occurring because a pathological example using a
very large precision was used in inferring the precision of a currency and a
subsequent attempt to quantize a large number exceeded the default precision.
2020-11-22
- Fixed bug in parser.parse_file() which when passed a filename in would leave
the file unclosed.
- Fixed latent bug with key/value parsing (incorrect grammar rule, was working
anyway somehow).
- Internal changes to lexer and parser to minimize diffs with ongoing work in
'master' / C++ scanner/parser.
2020-11-17
- Made it legal to insert a balance entry after account closure. It is a common
case that transactions happen on the last day of an account and the balance
directive operates at the beginning of the day. It was arguable whether
directives should be allowed after closure; notes and documents were allowed
because statements and phone calls may still occur after an account is
closed, but I suppose you can make the argument that a statement balance can
also occur at a later date, so voila, make it legal. You still cannot post
transactions to a closed account, which is the thing that really matters.
2020-11-15
- Render the tolerance in Balance directives (merged from Aaron Lindsay).
2020-11-01
- In the process of removing dependencies to the beancount.ops.holdings module,
significantly sped up the net-worth-over-time script by using simple
aggregation to an inventory (which is how it should be done).
- Allow balance_by_account() method to compress positions that aren't booked,
as an option.
- Added split() method to Inventory, like segregate_units but with no
constraints.
- Fixed #255: Added a new beancount.core.prices.project() method to project
prices to another cost currency.
2020-10-26
- Fixed Github Actions workflows and Wheel generation.
- Released 2.3.3 to trigger new binaries.
2020-10-25
- Removed the part of setup_test checks running the binaries with --help, as
they fail starting at 3.8. Someone with more time would create a test using
pytest-virtualenv.
2020-10-17
- Fixed #566: Duplicate postings on entries should count toward distinct
hashes.
2020-10-10
- Moved Emacs support to its own repository
(http://github.com/beancount/beancount-mode).
2020-09-12
- Added metadata on implicitly generated Price directives (from implicit_prices
plugin).
2020-09-12
- Released 2.3.2.
2020-09-07
- Fixed #401: Fixed initialization bugs on min() and max() functions for the SQL
aggregator.
- Fixed #364: Fixed important core bug in how the CostSpec were converted to
Cost for cost specs with total and per-unit cost numbers, like this {106.935
# 6.98 USD}. For short positions, the cost was computed as negative. In a
sense this was a naive bug, but a very important one. This occurred only for
short positions.
2020-08-19
- Added an option to the printer to allow an arbitraty Python value to be
output. This is useful when creating values programmatically with types not
supported by the syntax.
2020-07-25
- Release 2.3.1 as dependency for beanprice.
- Moved beancount.prices.find_prices to beancount.ops.find_prices in
preparation of moving price fetching code to a new 'beanprice' repository.
2020-07-17
- Fixed bug #508 in beancount.plugins.unique_prices.
2020-07-06
- Updated export script to honor lowercase "ignore" instead of "IGNORE" and set
default tax type to "taxable" instead of "TAXABLE" so that changes in PR 472
don't pick up the metadata as currencies.
2020-07-05
- Removed bean-report and all associated codes. Use bean-query instead (or
Fava).
- Removed bean-web and bean-bake (for v3). Use Fava instead.
- Moved beancount.web.scrape to beancount.utils.scrape in preparation of
removing beancount.web.
- Removed experiments/portfolio for its dependency on beancount.reports code
(this script was obsolete anyway).
- Moved get_assets_holdings() function out of reports code to preserve it for
use by an experimental script (in preparation for removing beancount.reports).
- Moved beancount.scripts.tutorial to beancount.reports.tutorial in preparation
of removing beancount.reports and beancount.web.
- Moved beancount.reports.context to beancount.parser.context in preparation of
removing beancount.reports and beancount.web.
- Moved beancount.reports.table to beancount.utils.table in preparation of
removing beancount.reports and beancount.web.
2020-07-04
- Fixed #494, invalid account used for clamping the period view
(Equity:Conversions:Previous instead of Equity:Conversions:Current).
2020-06-27
- Merged PR #484, some parser improvements by @dnicolodi.
- Merged PR #488 from branch beancount/pr135_ppmarciniak_fixnetworth by
@pmarciniak.
- Merged branch pr131_tohojo_csvtweaks (BitBucket PR 131) by @tohojo, fixed
encoding bug in reading the file for the date and allow customizing the
number parser.
2020-06-26
- Merged #480 - parser: Read input data from Python file objects by dnicolodi.
2020-06-10
- Released 2.3.0. See #459.
2020-06-03
- Added a 'hooks' argument to beancount.ingest.scripts_utils.ingest() replacing
'detect_duplicates_func'. 'find_duplicate_entries()' is still inserted if no
other filter functions are specified (I'd like to remove this eventually; not
changing behavior here for now.)
- Added an example for how to run the importers explictly via a Python script
calling the ingest() function.
- Fixed bug with explicit invocation of importers via ingest() function when
calling the 'file' sub command.
- Some installations of pdfminer install 'pdf2txt.py' as 'pdf2txt'. Adjusted
ingestion example scripts.
2020-06-02
- Modified recently added --no-cache option to also delete the cache if it
exists. Honor the same environment variables. The motivation behind this
change is that while --no-cache is useful for debugging plugins, it can be
disconcerting that if you remove it on the next run it picks up the old
existing cache. Deleting it on usage of --no-cache is reasonable behavior and
avoids the introduction of a --clear-cache option; this should be sufficient.
2020-05-25
- Fixed #449: Added options to bean-check: --no-cache and --cache-filename to
override the cache location. These are added to bean-check only and are
useful during development. The 'BEANCOUNT_DISABLE_LOAD_CACHE' and
'BEANCOUNT_LOAD_CACHE_FILENAME' environment variables are still honored by
the loader and work across all other programs.
2020-05-23
- Fixed #184: Added explicit test for Inventory.average().
- Fixed #404: Iex price source not working any more.
- Fixed #281: Query "id" column does not identify transactions uniquely. Made
the default hash_entry() function include metadata. Exclude metadata and
derived fields explicitly in the context of comparison.
- Fixed #182: Eliding an amount with total price raises TypeError.
- Added options to filter accounts in "onecommodity" plugin: skip accounts with
explicitly declared commodities, metadata of "onecommodity: FALSE" and added
regular expression to specify the list of accounts to match (default: all).
2020-05-22
- Migration of code repository to Github.
2020-05-02
- Minor performance improvment by avoiding calling __iadd__ in a few places.
- Fixed bug due to the removal of __version__ in apiclient:
https://github.com/googleapis/google-api-python-client/commit/1d8ec6874e1c6081893de7cd7cbc86d1f6580320
- Changes all imports from 'apiclient' to 'googleapiclient', which is now the
recommended way.
- Fixed some warnings.
- Disabled expensive assertions in Inventory class and implemented a special
case for adding to an empty inventory to avoid expensive aggregation. This
can occur in aggregation loops and is unnecessarily expensive when adding a
single, very large inventory.
- Made balance check aggregation avoid an initial empty inventory object, and
changed the balance check code to call the realization utility function
compute_balance().
2020-04-11
- Fixed #425: Tentative bug fix for crash on decref over null traceback. The
Python API for this function may return some null values. Not taking any
chances. This should fix this particular bug.
2020-03-28
- Allow the "divert_expenses" plugin to override diversions on postings that
aren't for expenses accounts. I needed this to account to a deposit to my
kid's daycare, which is an asset account in his diverted ledger.
2020-03-22
- Added docstrings on some import code (while installing a new importer; my
stuff is sometimes poorly documented I'm afraid).
2020-02-23
- Added new features to the CSV importer:
* A new 'invert_sign' option to invert the sign of the amount.
* A new field, 'CATEGORY', which goes unrendered.
* Replace newlines from all narrations by semi-colons.
These were driven by recent changes to the Amex CSV format.
2019-12-29
- Added a CSV field for a unique reference number. If present, this is set as a
link on the transaction.
2019-12-25
- Applied patch from Daniele Nicolodi
(https://bitbucket.org/blais/beancount/pull-requests/139/parser-work-around-python38-bug-causing-a)
to work around typing constraints around signed size types introduced in
Python 3.8. See also https://bugs.python.org/issue38913.
- Fixed bug with running python3 as a subprocess during testing. Fixes an error
that occurs with the tutorial file generation.
2019-11-29
- Added 'encoding' option to CSV importer. Amex encodes as 'latin1', not
'utf-8' and this turned out to be necessary.
2019-11-10
- Added an option to upload-to-sheets script to apply a minimum to the number
of rows resized to. The problem was I had another sheet longer than the
auto-updated data sheet, and when new rows were being inserted, rows in the
referencing sheet were being incremented automatically to refer to the now
displaced previous rows in the updated data sheet (even if they used to refer
to rows after the last row in the data sheet). Avoid resizing in the number
of rows up or down sheet should avoid most of these problems (except when at
the boundary, but then the minimum number of rows could just be increased).
This is quick fix that should work in the medium term.
2019-10-20
- More changes to unittest while porting to Bazel build (for C++ support).
2019-10-11
- Added __main__ block to all tests because ongoing port to Bazel build
requires it.
2019-10-10
- Moved test data for b.utils.file_type for Bazel support. It otherwise assumes
file_type.py is a package.
2019-08-21
- Released 2.2.3.
- Fixed bug in split_expenses plugin.
2019-06-01
- Upgraded Bison to 3.4 (built from source). Silenced warnings.
2019-05-01
- Fixed #389: Patch for b.p.forecast improvements.
- Added rolled back change to default value of flag used when using the 'txn'
syntax. See issue #295 for a discussion.
2019-03-16
- Had a very quick shot at implementing trade tracking, added the list of
matches positions from the booking methods. This doesn't work yet, I need to
make changes to b.c.Inventory in order to make this work. Partial
changelist.
2019-03-03
- Fixed #378: Rendering metadata with null values wasn't properly implemented.
In the process, I explicit parsing of None values by allowing "NULL".
- Fixed #309: Catch PermissionError to work around
https://bugs.python.org/issue25481.
2019-02-27
- Implemented a quick prototype of the current trading accounts method of
Peter Selinger in 'beancount.plugins.currency_accounts'. A few warts remain:
* FIXME: We need to handle these important cases (they're not frivolous,
this is a prototype), probably by inserting some exceptions with
collaborating code in the booking (e.g. insert some metadata that
disables price conversions on those postings).
* FIXME(2): Ouch! Some of the residual seeps through here, where there
are more than a single currency block. This needs fixing too. You can
easily mitigate some of this to some extent, by excluding transactions
which don't have any price conversion in them.
2019-02-26
- Fixed #376: Coerce implicit boolean to true boolean.
2019-02-10
- Fixed #374: Option --all treatment was broken in #210. Also catch and print
errors.
- Fixed rare failure of shutil.rmtree() in encryption cleanup test.
2019-02-03
- Fixed #372: Removed formatted string literal to keep compat with Python 3.5.
2019-01-29
- Fixed #362: Predicate matching a parent account was matching accounts with
word breaks but not at the boundary of an account name. This was causing
a rare (but important) failure in how Pad balances were calculated.
2019-01-28
- Released 2.2.1 for bug fixes.
2019-01-25
- Improve output of tags and links for bean-report ledger and hledger.
2019-01-22
- Fixed problem with invalid format strings with 0-width field when rendering
MISSING.
2019-01-05
- Merged pull request #85
(https://bitbucket.org/blais/beancount/pull-requests/85) from hardikar,
adding function grepn() to the shell.
- Merged pull request #86
(https://bitbucket.org/blais/beancount/pull-requests/86) from hardikar,
adding function subst() to the shell.
- Merged pull request #89
(https://bitbucket.org/blais/beancount/pull-requests/89) from hardikar,
adding functions date_diff(), date_add() to the shell.
- Implemented best compression for zipfile in bean-bake as per Justus
Pendleton's suggestion. For context, see this:
https://groups.google.com/d/msgid/beancount/de75671d-532a-4deb-bd0f-fd9377e63753%40googlegroups.com?utm_medium=email&utm_source=footer
2018-12-18
- Fixed #214: Add directory of current filename to sys.path with new option
"insert_pythonpath". When this option is encountered in a file, we prepend
the path of the file in which it is encountered at the front of the
PYTHONPATH for the rest of the duration of the problem (we could consider
resetting this after parsing and processing the plugins; not doing it now).
- Added detection of hitting the root if the search for the repository root
failed.
- Fixed #341: find_repository_root() fails on source tarball. Renamed PKGINFO
to PKG-INFO to match what pip sdist produces.
- Change version number from 2.2.0-devel to 2.2.0-dev which apparently is
recognized by pip (thanks Jakob Schnitzer).
https://bitbucket.org/blais/beancount/pull-requests/91/default/diff#comment-85707662
2018-12-12
- Suppressed almost all the Python 3.8 warnings.
2018-11-16
- Added more logging in loader (done while debugging something else).
2018-10-26
- Fixed #302: Fixed second bug with font-locking for account names (starting
with digit).
- Fixed bug ingest that would cause relative filenames to fail.
See this thread for details:
https://groups.google.com/d/msgid/beancount/709141d5-88a4-444a-acef-94bf43a9b388%40googlegroups.com?utm_medium=email&utm_source=footer
- Fixed bug in ingest whereby the custom duplicates detection function wasn't
being called.
2018-10-25
- Fixed unit test failure on BitBucket pipelines using a temp directory
context manager.
- Applied PR by Richard W to install the mixins package (install was broken).
- Fixed #302: beancount.el does not fontify account names with single letter
components (based on bug report by arianaut@).
2018-10-13
- Fixed #158: Missing MIME type for QFX files.
2018-10-04
- Merged new_ingest_mixins: Added new implementations of mixins for ingestion:
* beancount.ingest.importers.mixins.identifier which implements identify().
* beancount.ingest.importers.mixins.filing which implements file_account()
and file_name().
* beancount.ingest.importers.mixins.config which implement a simple schema
with a configuration.
These new mixins are intended to be more independent and more easily
composable than the older ones. The beancount.ingest.importers.regexp has
been removed. If you need it in interim, I made a copy under
experiments/ingest/regexp.py.
* Version: 2.1.3
2018-10-04
- Fixed #323: Escape strings in printer.
- Minor bug fix for beancount.prices.price on null result.
2018-09-19
- Removed TRUNCATE(), after realizing ROOT() can already do the same thing.
2018-09-18
- Added TRUNCATE() function to SQL shell for Vikas Rawal.
2018-09-03
- Added a parameter to the cmptest assertions to disable real booking and
allow a weak local form of booking conversion that allows interpolation.
(I'm using this in another project to assert some incomplete transactions.)
2018-08-30
- Made assertions on entries off of the TestCase class, as free functions (so
that they can be used in another project).
2018-08-26
- Fixed tests for pipeline running pytest (somehow the curses functions fail,
probably due to better environment isolation from pytest).
- Implementation of beancount.ingest.regression_pytest, a pytest replacement
for beancount.ingest.regression, which was for nose. This is simpler and
better and more straightforward (no conditionals; all regression files must
have all accompanying expect files and all must pass). See the module
docstring for new instructions on how to use this.
This should not break the older tests, as I haven't changed the older
support. It (beancount.ingest.regression) will be removed eventually.
(This completes porting Beancount to use pytest instead of nosetests.)
2018-08-25
- Today we're switching to pytest as the official test runner. All the tests
pass, and it even runs faster. It's about time!
- Removed all references and workaround to nose.
2018-08-23
- Oops... removing forgotten trace in bean-web.
- Fixed #325: Implemented support for including encrypted files (for Milind Kamble
and using some of this changes).
2018-08-17
- Added 'issuer' column to the export script. I'm going to use this to produce
a deaggregated list of exposure to individual stocks from a list of ETFs.
2018-08-25
- Upgrade requirement to bison-3.0.5 for development.
2018-08-12
- After many years of using something like it to track my investment portfolio
using a Google Sheets doc, I cleaned up, rewrote and move the asset list
exporting script to beancount.projects.export and deleted the old version
under experiments/upload.
2018-08-05
- Fixed #322: Adjustments to StopIteration treatment from within generators
were breaking bean-example generation code.
- Implemented a new plugin which asserts that on accounts with 'NONE' booking
method reducing postings' cost basis is within the vicinity of the average
cost basis in the account. This allows you to approximate the 'AVERAGE'
booking method avoid too much cost basis leakage until it's implemented
properly.
2018-08-02
- Created a new 'commodity_attr' plugin to asset the presence and validity
(in a set, like an enum) of metadata attributes on Commodity directives.
I export my holdings joined to a table of per-Commodity attributes and I've
made a mistake this week that ended up showing up as an overestimated
portfolio value on my portfolio tracking Google Sheets doc.
2018-07-31
- Fixed bug in new ingest() function found as I refactored my importers.
- Fixed bug with the pipeline making sure to set the CWD of the subprocess
when we run an import test.
- Fixed bug with previous commit containing stray 'string' reference. (My
environment has autoimports by default.)
- Implemented a beancount.ingest.scripts_utils.ingest() function that will act
as a main program, so you can write your own importer scripts from top to
bottom without having to rely on bean-identiy, bean-extract or bean-file.
The purpose of this change was to allow the user to insert an optional
argument 'detect_duplicates_func' in order to implement their own duplicates
detection. See discussion under
https://bitbucket.org/blais/beancount/pull-requests/75/. In order to install
your duplicates detector, just call ingest at the end of your importer
script, like this:
my_importers = [ ... ]
ingest(my_importers, my_duplicates_func)
I could have chosen to add a "hook" option and such to Beancount, but I
preferred moving the whole import framework one level closer to code. I also
like that it's not just an imported module; it's really just your script,
with three subcommands. You could add more custom import-level stuff in
there. The ingest() function is a main program, and commands like
bean-extract myimporters.py ~/Downloads --reverse -e myledger.beancount
are invoked similarly by calling the Python script directly, like this:
./myimporters.py -d ~/Downloads extract --reverse -e myledger.beancount
These two should be equivalent.
The older way of doing things--that is, calling bean-identify, bean-extract
and bean-file--are still supported regardless of whether you've inserted a
call to ingest() in your importers configuration or not. This is made to
work via a rather labyrinthine trampoline of functions calls (in particular,
getting the arguments setup right was surprisingly tricky).
I'm still debating whether this should be "the new way", or just for those
wishing to build their own duplicate detection heuristic. Feedback (on the
list) would be interesting.
2018-07-29
- Updated to flex-2.6.4.
2018-07-28
- Added a utility to import modules by dotted string name.
2018-07-19
* Fixed #319: Incorrect version number from 2.1.2-devel to 2.1.3-devel.
2018-07-28
- Added automated unit test for calling identify() from the importers test
suite, expecting True, always.
2018-05-31
- Created a new plugin: "fill_account" to automatically insert a posting with
a default account name where there's a single posting. Will use this while
traveling as a lot of the expenses come from cash; this should significantly
shorten such files.
- Changed template for version number from {date|short} to {date(date, "%s%)}
as per discussion on #304 (thanks to Jason Chu for looking up the detail for
this).
2018-05-29
- Refactored the call to find duplicates in imported files so that it can be
called only once with all the results from all the importers. This should
eventually allow a user-provided function that can merge entries between
importers. Existing behavior should be unaffected (though there may be a
small delay until everything gets printed out; all the importers are invoked
before any output is written). See #298.
2018-05-28
- Fixed bug with tempdir being a symlink on Mac, which was making one test
fail.
- Fixed unit tests which failed due to timestamps getting rendered with an
offset on a Mac while on a train in Japan.
- Render tags and links on Document directive.
- Minor bug fix: don't fail on rendering a MISSING instnace.
- In 'divert_expenses' plugin, allow limiting diversions to one posting only.
- Fixed unit test for git checkouts. This should fix the Travis-CI build.
* Version: 2.1.2
2018-05-12
- Fixed setup.py to catch exceptions in the absence of git as well.
* Version: 2.1.1
2018-05-12
- Fixed installation with missing version string.
* Version: 2.1.0
2018-05-12
- Added back lexer test from Adrian Medrano Calvo's UTF8 changes to head.
2018-05-08
- Fixed #287: In the price fetcher, store the datetime instances as
naive-in-UTC in order to avoid a serialization problem with older Python
versions.
2018-05-06
- Changes to support git versioning if hg versioning is not available.
2018-05-05
- Fixed #289: Add option to find beancount version. All scripts now support
--version.
- Amended PR64 to remove the need for __getitem__(). Clarified docstring.
- Merged PR64 from Jakob Schnitzer: Inventory: use dict instead of list as a
base.
2018-05-04
- Fixed #290: Validation of account name components was incorrectly swapped.
2018-05-03
- Amended PR74: Adding a new unit test, fail if tags / link appear after the
first posting. Performance amendment to tags/links and clarification to the
freezing of tags & links and their default values.
- Merged PR74 / Fixed #99: Allow tags and links to be spread over several
lines.
- Amended PR14: added simple unit testing for regexp, changes in parsing UTF-8
account type to match changes in Beancount head.
- Merged PR14 by Adrian Medrano Calvo: Support account names to consist of
Unicode letters and numbers.
2018-05-02
- Removed a few accidental __author__ metadatas from files, normalized to
__copyright__ as all other files.
2018-05-01
- Added patch for clean build for lexer. 2.6.1 results in a build warning.
- Merged PR73 (Ethan Glasser-Camp) - Cleanups to lexer and more restrictive
syntax for comments within a transaction's indented block.
- Fixed failing test re. new grammar.
- Merged PR29: Update grammar to allow comments in the middle of transactions
(Ethan Glasser-Camp).
- Merged PR71: Use enhanced extract method which passes existing entries
(Patrick Ruckstuhl).
2018-04-29
- Added polymorphic POSSIGN(_, account) function to the SQL shell in order to
support correcting for per-account sign.
- Implemented polymorphic NEG() function in the SQL shell, which works on
instances of Decimal, Amount, Position, Inventory.
- Changed the SQL shell's operators to dispatch to Python's default operator
selection instead of coercing to Decimal instances.
2018-04-28
- Added QUARTER() function to the SQL shell.
(See https://groups.google.com/d/msg/beancount/fTlSnQRPayo/1yN8zd76AAAJ.)
- Updated version of flex on Ubuntu (2.6.1) generates warnings. Fixed a few.
But Beancount now fails on account names with a dash in them; added a test
for those. (The lexer is not the issue; I suspect a bison update from 4/17.)
2018-04-18
- Fixed #157: Building a price map with zero prices should not fail,
especially when done accidentally.
- Fixed #264: Converted zip compression in bake from using an external zip
tool to using the 'zipfile' module packaged with Python. I'm doing this to
fix the CI build as well.
2018-04-17
- Fixed #265: Refined the timezone specification of the price sources. In
doing this, I documented it in the beancount.prices.source module and now
pass in a timezone-aware datetime instance instead of a date, and the source
is now required to also require a timezone-aware datetime instance. I fixed
all the tests, and added a utility to simulate running them from different
timezones.
- Implemented multi-file support for bean-doctor context command. Use it like
this:
bean-doctor context <toplevel.beancount> <file.beancount>:<lineno>
The previous syntax is still supported; like this:
bean-doctor context <toplevel.beancount> <lineno>
2018-04-05
- Since I added a dependency on 'requests', forgot to add to checkdeps. Done.
2018-04-04
- Handle error on an invalid implementation of a price source (e.g., in this
case an obsoleted price source string of 'google' imports something else and
referenceing .Source fails).
- Bubble up error from Yahoo price source.
- Fixed #267: Implemented a price source from the IEX exchange.
2018-04-03
- Implemented Quandl importer on its REST API. Another implementation, based
on the Quandl Python client API was proposed by Hugo Ideler (see PR34), but
I didn't want to add a dependency on the client library (nor on Pandas), and
after reading the description on Quandl API's website, I figured the library
was simple enough the output could be parsed directly. I wrote a new
implementation from scratch, parsing just the time-series datasets.
- Merged PR68 from Martin Michlmayr, added Travis Yaml support file.
- Fixed Emacs functionality to uncomment regions (change submitted by Stefan
Monnier on the list).
2018-04-02
- Fixed #193: Removed the broken Google Finance price source importer. Google
has removed this service in the favor of a special Search page and this has
been broken for the recent little while.
- Fixed #203: Updated the Yahoo price source implementation to use the
undocumented v7 and v8 APIs; moved away from the "ichart" and "download"
APIs. The Yahoo importer is back in function.
This introduced a new dependency on the awesome 'requests' library, which
really, was quite inevitable).
2018-04-01
- Merged PR65: Use parse_version to compare versions; then replicated
parse_version() locally to avoid the dependency on setuptools.
- Merged PR15 by Johannes Harms:
Added the following features to the forecasting plugin:
- Yearly repetition of recurring transactions (instead of just monthly)
- Users may optionally specify an end date
- Users may optionally specify the number of repetitions
"I used this code to calculate scenarios for a possible real estate purchase
and I contribute a cleaned-up version as an example file."
- Merged PR54 & Fixed #232: Align quoted commodities correctly in ledger price
statements (from Martin Michlmayr).
- Merged PR57: query_execute: Allow ordering by columns which may be None
(from Jakob Schnitzer). Made some adjustments to generalize on all
datatypes.
- Merged PR62: Also allow 0/0 in SAFEDIV() (from Jakob Schnitzer), with small