Skip to content

Releases: Yoctol/uttut

1.4.10: New Operators (AddWhitespaceAroundWordnZhChar, ReplaceAwithB)

20 Jun 06:13
31a456b
Compare
Choose a tag to compare

Main Modifications:

  • #136 version 1.4.10
  • #135 ReplaceAwithB
  • #134 AddWhitespaceAroundWordnZhChar

1.4.9: Add Operator - PureNum2Token

17 Jun 10:40
ea8a508
Compare
Choose a tag to compare

Main modifications:

  • #132 Added operator - PureNum2Token

1.4.8: [Fix BUG] Forgot setting `include_package_data = True`

14 Jun 10:18
8809cf2
Compare
Choose a tag to compare

Main Modifications:

  • #131 Set include_package_data = True in setup.py, so non-code files can be added
    in the package when installing.

1.4.7: [Fix BUG] Forget uploading stopwords.txt

14 Jun 08:09
30a88a7
Compare
Choose a tag to compare

Main Modifications:

  • #130 Fixed BUG of version 1.4.6.
    We forgot uploading stopwords.txt to PYPI.

1.4.6: More Operations

14 Jun 03:40
8d34c0a
Compare
Choose a tag to compare

Main modifications:

  1. (#123): Create an operation which can replace chinese stopwords with whitespace.
  2. (#124): Developers can indicate a specific file or folder when running unit tests.
  3. (#125): Operations which replace digits with special tokens now can handle fullwidth digits.
  4. (#126): Create an operation - NumTokenwithSpace which can replace continuous digits with token _num_.
    Note that it is 87% similar to IntTokenwithSpace.
  5. (#127): Let everyone know that we can reproduce Bert preprocessing through pipe.
  6. (#128): Users can check version of uttut via the following commands:
>> import uttut
>> uttut.__version__
1.4.6

1.4.5: Human Readable Dump

06 Jun 03:58
8a5823b
Compare
Choose a tag to compare

Main modifications:

  1. uninstall pypandoc, use content_type instead #120
  2. human readable dump #121

1.4.4: Pipe utility

07 May 07:15
27db227
Compare
Choose a tag to compare

Pipe supports +, +=, getitem, copy

1.4.3: Pipe Summary

04 May 06:26
768c566
Compare
Choose a tag to compare

support pipe.summary() to show detail steps & checkpoints

1.4.2: Import Sugar

03 May 15:36
81223b1
Compare
Choose a tag to compare

can import Pipe from uttut.pipeline

1.4.1: Backward Compatibility

15 Apr 04:29
Compare
Choose a tag to compare

Let Pipe.deserialize support old format